-- Logs begin at Tue 2022-07-26 12:03:51 UTC, end at Tue 2022-07-26 13:12:43 UTC. -- Jul 26 12:37:04.626588 dv-cinder-850939-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 12:37:04.633745 dv-cinder-850939-2-smb devstack@keystone.service[91758]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 12:37:04 2022] *** Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: nodename: dv-cinder-850939-2-smb Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: machine: x86_64 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: clock source: unix Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: pcre jit disabled Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: detected number of CPU cores: 4 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: current working directory: / Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: detected binary path: /usr/bin/uwsgi-core Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: your processes number limit is 47680 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: your memory page size is 4096 bytes Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: detected max file descriptor number: 2048 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: lock engine: pthread robust mutexes Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: thunder lock: enabled Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 12:37:04.638947 dv-cinder-850939-2-smb devstack@keystone.service[91758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 12:37:04.676920 dv-cinder-850939-2-smb devstack@keystone.service[91758]: Python main interpreter initialized at 0x5608cd1ee9c0 Jul 26 12:37:04.676920 dv-cinder-850939-2-smb devstack@keystone.service[91758]: python threads support enabled Jul 26 12:37:04.676920 dv-cinder-850939-2-smb devstack@keystone.service[91758]: your server socket listen backlog is limited to 100 connections Jul 26 12:37:04.676920 dv-cinder-850939-2-smb devstack@keystone.service[91758]: your mercy for graceful operations on workers is 90 seconds Jul 26 12:37:04.677282 dv-cinder-850939-2-smb devstack@keystone.service[91758]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 12:37:04.677364 dv-cinder-850939-2-smb devstack@keystone.service[91758]: *** Operational MODE: preforking *** Jul 26 12:37:04.677605 dv-cinder-850939-2-smb devstack@keystone.service[91758]: *** uWSGI is running in multiple interpreter mode *** Jul 26 12:37:04.677605 dv-cinder-850939-2-smb devstack@keystone.service[91758]: spawned uWSGI master process (pid: 91758) Jul 26 12:37:04.677829 dv-cinder-850939-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 12:37:04.678973 dv-cinder-850939-2-smb devstack@keystone.service[91758]: spawned uWSGI worker 1 (pid: 91770, cores: 1) Jul 26 12:37:04.678973 dv-cinder-850939-2-smb devstack@keystone.service[91758]: spawned uWSGI worker 2 (pid: 91771, cores: 1) Jul 26 12:37:04.678973 dv-cinder-850939-2-smb devstack@keystone.service[91758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 12:37:10.192983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:37:10.192983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: from cryptography.utils import int_from_bytes Jul 26 12:37:10.193790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:37:10.193790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: from cryptography.utils import int_from_bytes Jul 26 12:37:10.195748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:37:10.195748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: from cryptography.utils import int_from_bytes Jul 26 12:37:10.196222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:37:10.196222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: from cryptography.utils import int_from_bytes Jul 26 12:37:10.244156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:37:10.244347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:37:10.244542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] command line args: [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:37:10.244810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:37:10.244989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ================================================================================ {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:37:10.245079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:37:10.245207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:37:10.245294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] admin_token = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.245401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] command line args: [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:37:10.245489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] config_dir = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.245644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.245732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:37:10.245831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] config_source = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.245907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ================================================================================ {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:37:10.246017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] debug = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] admin_token = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] config_dir = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] config_source = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] debug = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.246994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_config_append = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.247977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_dir = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_file = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_config_append = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_dir = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_file = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.248921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.249906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.250979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.251926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] publish_errors = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] publish_errors = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.252980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] standard_threads = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.253981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] standard_threads = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] use_journal = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] use_json = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.254961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] use_stderr = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] use_syslog = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] use_journal = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] use_json = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] use_stderr = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.255895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] use_syslog = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.256126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:37:10.256369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.256967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.257936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.258774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.259503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.259629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.259759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.259877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.260898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.261990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.262939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.263906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.264959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.265937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.266956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.267892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.268952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.269922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.270959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.271945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.272895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.273913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.274991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.275977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.276917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.277961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.278953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.279922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.280970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.external = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.281880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.password = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.external = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] auth.token = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.282889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.password = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] auth.token = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.283955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.284913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.285896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.286971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.287944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.288906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.289884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.290884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.291947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.292948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.293919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.294883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.295964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.296913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.297951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.298916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.299983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.300959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.301926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.302888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.303939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.304997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.305125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.305250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.305368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.305486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.305603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.306884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.307950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.308903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.309972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.310942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.311903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.312979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.313958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.314912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.315946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] role.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] role.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.316900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] role.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] role.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.317945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.318915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.319983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.320940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.321059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.321176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.321300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.321466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.322962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.323922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.324999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.325958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.326912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.327987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.328937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.connection = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.329959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.connection = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.330926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.331890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.332979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:37:10.333999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:37:10.359702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.359865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.359950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.360027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.360151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.360239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.369375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.369847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.399795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.400017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.400245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.400483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.453501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.453652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.504449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.504686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.505043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.505279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.570183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.570355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.570579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.570799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.570884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.571018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.571103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.571234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.571815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.572185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.572574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.572803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.595812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.595921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.596930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.597014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.597138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.597231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.608426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.608525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.621464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.621702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.621824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.621954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.622920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.623048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 12:37:10.640101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.640314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 12:37:10.640649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.640852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 12:37:10.641003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.641120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.641203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 12:37:10.641380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.641532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.641636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.641728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 12:37:10.641916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.642001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.642248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.642500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.642750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.652155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.652431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.652702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.652978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.653313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.653588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.653876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.654158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.659903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.661113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.664569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.664846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.665207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.665533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.665825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.666362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.666988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.667176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.667256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.667434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.667526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.667981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.668255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.668522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.668789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.669050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.690376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.691867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.692150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.692303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.693785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.694085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.697381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.697655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.697964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.699510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.699788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.700067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.704615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.704896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.706666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.706954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.709027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.709315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.709595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.709898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.710172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.710457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.710727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.711001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.711218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.711503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.711798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.712682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.713157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.713440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.713711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.714021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.727451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.727757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.730334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.730610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.731818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.734523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.734995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.735290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.737638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.737959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.739943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.742643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.743281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.746327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.746574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.746870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.747154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.747439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.747728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.748024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.749454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.749748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.750051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.750331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.750612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.750900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.764533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.764824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.765092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.765356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.767685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.767966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.768232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.768491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.772286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.773859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.774138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.776584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.777503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.777784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.778110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.778206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.778396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.778480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.778684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.781176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.781466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.781743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.782060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.782344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.790133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.790413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.790694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.791033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.791363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.791639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.791924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.794217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.794497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.794772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.795048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.795323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.795590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.795857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.808264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.811256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.812284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.814240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.815263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.816684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.818222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.818480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.818767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.819050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.820685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.822568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.822856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.823173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.825576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.827227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.829570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.830169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.830459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.830740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.831018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.831196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.834123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.834409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.834697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.834969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.839586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.839875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.840157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.843764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.844048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.844324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.847013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.847296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.847588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.847876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.848158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.848436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.848707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.848988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.849350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.849631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.849953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.850221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.850510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.850758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.851127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 12:37:10.851405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.851680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.851962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.852234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.852497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.853474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.853994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.854389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.854668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.854961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.855224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.855489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.855748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 12:37:10.885054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608cd1ee9c0 pid: 91770 (default app) Jul 26 12:37:10.888342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c27d-4e70-4402-9977-403dc0c25dee None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:10.888640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c27d-4e70-4402-9977-403dc0c25dee None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:10.888921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c27d-4e70-4402-9977-403dc0c25dee None None] PATH_INFO: `/v3` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:10.890158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608cd1ee9c0 pid: 91771 (default app) Jul 26 12:37:10.893284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Tue Jul 26 12:37:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:18.514756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:18.515324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:18.515324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:18.519757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:37:18.525498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:18.525955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:18.526084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:18.596553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: INFO dbcounter [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] Registered counter for database keystone Jul 26 12:37:18.618214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG oslo_db.sqlalchemy.engines [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:37:18.624412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writer thread running {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:37:18.804071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG passlib.handlers.bcrypt [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91770) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 12:37:18.804412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG passlib.handlers.bcrypt [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91770) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 12:37:18.858609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:18.860253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:18.983630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 12:37:19.016976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:19.086410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: INFO dbcounter [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] Registered counter for database keystone Jul 26 12:37:19.106269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG oslo_db.sqlalchemy.engines [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:37:19.112314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writer thread running {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:37:19.233222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca4b8-a111-47d9-95c6-02f695cd09ea None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:19.237461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:19.238124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:19.238413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:19.238694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:19.247160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:19.298108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING keystone.common.rbac_enforcer.enforcer [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 12:37:19.298453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e5dba-7205-4d66-8c9e-2b8f8ae05ff4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:19.308036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Jul 26 12:37:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 12:37:19.313994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:19.328441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d277160-60dc-4e4f-ae4d-6e5fd0c82d2d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:19.332858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:19.334035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:19.334328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:19.334607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] PATH_INFO: `/v3/projects/269bfb061a4341bbbc905a39cb4bf398` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:19.336099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] RBAC: Authorizing `identity:get_project(project_id=269bfb061a4341bbbc905a39cb4bf398)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:19.386815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 12:37:19.387115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6856b73-d1be-47e5-97fd-3e2b4b09b15b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:19.391753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Tue Jul 26 12:37:19 2022] GET /identity/v3/projects/269bfb061a4341bbbc905a39cb4bf398 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:21.365466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c77ae-5876-4cde-a1d9-514a60914ed4 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:21.366014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c77ae-5876-4cde-a1d9-514a60914ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:21.366114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c77ae-5876-4cde-a1d9-514a60914ed4 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:21.370674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:21.375958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:21.376335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:21.376520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:21.396683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:21.398215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:21.406155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 12:37:21.427456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c77ae-5876-4cde-a1d9-514a60914ed4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:21.440199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c77ae-5876-4cde-a1d9-514a60914ed4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:21.444438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:21.445045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:21.445335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:21.445612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:21.453958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:21.455734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49683080-6ffc-471b-998b-e0be0f318729 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:21.464488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Jul 26 12:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 12:37:21.469666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:21.479154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b0a6-e31e-4429-a875-23c068aa94d8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:21.483455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:21.484081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:21.484365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:21.484642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:21.486027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:21.487838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76b36-8cf1-4796-8b8e-efb92c9c9b84 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:21.489622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Tue Jul 26 12:37:21 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:23.542338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce12e0-e54d-4167-89a1-fdb7cf2b0456 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.542883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce12e0-e54d-4167-89a1-fdb7cf2b0456 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.542883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce12e0-e54d-4167-89a1-fdb7cf2b0456 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.544214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:23.549189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.549629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.549759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.564537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843305-2ad5-4ed5-8f96-30ab1674f6e3 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.564823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843305-2ad5-4ed5-8f96-30ab1674f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.565101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843305-2ad5-4ed5-8f96-30ab1674f6e3 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.566443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:37:23.569405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:23.570639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:23.571991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.572428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.572712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.613677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG passlib.handlers.bcrypt [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91771) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 12:37:23.614126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG passlib.handlers.bcrypt [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91771) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 12:37:23.650690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:23.660437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:23.662073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:23.673246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:23.698085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:23.764559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:23.778936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e02b-ef6f-4681-ac3a-617a646d4be7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:23.785884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:23.813398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442412fc-ed42-4926-b049-677482239159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:23.814019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442412fc-ed42-4926-b049-677482239159 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.814308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442412fc-ed42-4926-b049-677482239159 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.814588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442412fc-ed42-4926-b049-677482239159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.826085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442412fc-ed42-4926-b049-677482239159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-442412fc-ed42-4926-b049-677482239159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:23.834861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:23.835945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:23.836972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:23.842287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442412fc-ed42-4926-b049-677482239159 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:23.887593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7f48c-1ef9-4d01-a5f3-41d0904d3cd2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:23.889856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:23.923225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:23.925112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:23.926040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.926332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.926832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.942148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442412fc-ed42-4926-b049-677482239159 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:23.975042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:23.975658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:23.975944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:23.976225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:23.976953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:23.977749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:23.979174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:23.991033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:23.994208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:23.995711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:23.997197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:24.095222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 12:37:24.097271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888623-70f7-4cf8-9c96-3102fc095164 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:24.100752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:24.104180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:24.208265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29339-d220-4ddc-9c5f-6e7b3e423c12 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:24.237281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:24.237954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:24.238241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:24.238527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:24.239947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:24.241393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:24.243545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:23 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:24.246704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:24.247551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:24.247829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:24.248102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:24.248915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:24.263353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:24.267340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:24.268797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:37:24.292590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:24.293631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:24.294661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:37:24.294661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:37:24.294661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:37:24.294661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:24.294917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:24.300722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:24.353344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10814-46df-4ca2-8b57-da509a2ff32a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:24.358532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:24.388260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:24.388906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:24.389194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:24.389891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:24.391102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:24.392581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:24.394187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:24.400308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:24.402355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f70b81-b62c-4d8b-aeab-cae84f3eea89 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:24.436064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:24.436684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:24.436969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:24.437246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:24.437979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:24.438292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:24.439677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc159bb-55fa-4299-bbeb-abe35f878741 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:24.456896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:24.482088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:24.503085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fad6d2-435b-48b1-947c-74abc9d62a7b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:24.540949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:24.541609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:24.541915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:24.542191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:24.542993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.domain.id=default, user.id=e89b70cb0e524eabb8d969a04efaa804) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:24.543296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:24.544775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156df6-f7a1-4c3b-9f7e-430797d8586f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:24.552296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Jul 26 12:37:24 2022] GET /identity/v3/role_assignments?user.id=e89b70cb0e524eabb8d969a04efaa804&scope.domain.id=default&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:26.851273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65b39-7132-4fd5-953f-67a254fdde80 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:26.852516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65b39-7132-4fd5-953f-67a254fdde80 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:26.853098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65b39-7132-4fd5-953f-67a254fdde80 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:26.854966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:26.860693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:26.861537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:26.862062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:26.881681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:26.883254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:26.965160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d046c-28fe-4ed1-bd4e-e7364a61cea1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:26.965782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d046c-28fe-4ed1-bd4e-e7364a61cea1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:26.966282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d046c-28fe-4ed1-bd4e-e7364a61cea1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:26.967806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 12/23] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:26.973142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:26.973738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:26.974312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:26.975887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:27.003090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:27.004606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:27.052908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.106776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:27.142287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.226173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.258930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.292439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685034c-1504-4186-bf9b-2d5f98a95982 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.332931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ccdda-a6c2-4c39-9363-905de380d95d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.338928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.339790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.340275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.340729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.354813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:27.357225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:27.371549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.372327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.372731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.373110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d609d28f-e72f-4339-8cdd-5d23a81bdf32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:37:27.378902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:27.379907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:27.380908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:37:27.380908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:37:27.380908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:37:27.380908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:27.382698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 13/26] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:27.384250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86426cf-d848-4222-a952-d39a73abe250 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.384691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86426cf-d848-4222-a952-d39a73abe250 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.385104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86426cf-d848-4222-a952-d39a73abe250 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.386534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 14/27] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:27.387993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5824-4c15-491d-9a73-3f732995f67a None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.388430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5824-4c15-491d-9a73-3f732995f67a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.388858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5824-4c15-491d-9a73-3f732995f67a None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.390605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 15/28] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:27.401860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:27.402011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.402011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.402011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e6a0ce97-f5bc-4bad-865c-485773a280f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:27.406313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:27.407166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:27.407945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:27.408922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.409345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.409874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.425149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:27.426409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:27.428285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:27.429552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:27.503212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:27.504062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.510308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 16/31] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:27.511264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.562439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.588588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.639157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c58ed-ddff-496a-98c8-60911ff0523a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.678519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.679556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.680091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.681119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.682098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:27.682608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:27.684367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:27.693481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 17/32] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:27.694594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.736526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814ab51-67e5-435a-8163-952cf2049695 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.772746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.773373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.773657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.773968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.774734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:27.775042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:27.776446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:27.788843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:27.795069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:27.806319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0073a5-9fbb-428b-b9a6-8ace73fea4c9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.842133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.844259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.845427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.846014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.846592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.847740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:27.849636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:27.900527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:27.906833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98dbb-dd56-4241-9755-8dd51fc86077 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:27.954174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:27.954174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:27.954174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:27.954174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:27.954570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:27.955246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.001302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 18/34] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Jul 26 12:37:27 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:28.002324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.081762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Jul 26 12:37:27 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:28.082795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.200208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3440-7bad-4b7a-8363-0f8f45cc862a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.206691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2303f-1c81-49ba-93e5-005c6b318a4b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.239820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.240459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.240743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.241021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.242357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.244628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a84b4a-3e57-42d5-aec2-9462ceaa7fd5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.287088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 18/36] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:37:28 2022] POST /identity/v3/projects => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:28.289669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4395-7e37-4fe6-9429-87e6bea65d17 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.290515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4395-7e37-4fe6-9429-87e6bea65d17 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.290812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4395-7e37-4fe6-9429-87e6bea65d17 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.293008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 19/37] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:28.296824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.299732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.300008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.300611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.300881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.301876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.302265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.305826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.307928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.314698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 19/38] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:28 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:28.315707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.325126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:28.327059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:28.329612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:28.402211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:28.418882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 20/39] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:28.450002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.486035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ce99-c01b-4784-b74b-b9f6ece32cc0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.526783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.527689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.528112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.528516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.529979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.531607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70585e4c-a48f-4399-9cc0-8ab4a587f78d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.533364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 20/40] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:28.535386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8273c4-e0bc-471b-accd-b72ccb00ab0f None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.535674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8273c4-e0bc-471b-accd-b72ccb00ab0f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.535954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8273c4-e0bc-471b-accd-b72ccb00ab0f None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.537336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 21/41] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:28.541935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8273c4-e0bc-471b-accd-b72ccb00ab0f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.584136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35adf1-acc0-4d1b-8d70-45f2a8d7ea3a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.619499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.620132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.620419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.620706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.621424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.622869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c088ae0-4492-4afe-a010-bfeb9d19f19c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.632040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:28.639040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Jul 26 12:37:28 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:37:28.640529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.641331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.641585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.656027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8273c4-e0bc-471b-accd-b72ccb00ab0f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.663233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:28.664486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:28.674504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:28.701738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.702457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.702744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.703028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] PATH_INFO: `/v3/domains/default/users/e89b70cb0e524eabb8d969a04efaa804/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.705096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e89b70cb0e524eabb8d969a04efaa804, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.706661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.722719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 22/43] 10.222.0.47 () {58 vars in 1361 bytes} [Tue Jul 26 12:37:28 2022] PUT /identity/v3/domains/default/users/e89b70cb0e524eabb8d969a04efaa804/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:37:28.750263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:28.773695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:28.888137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02eb89-6924-4ee3-b4b0-e540a4ee8f9b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:28.924776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:28.925435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:28.925726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:28.926047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:28.927207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:28.928678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab3b9f-f8dd-4615-96c3-665c6bc785cb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:28.930660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 23/45] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:28.935888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:29.033361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1d663-d44a-4a8e-bbbf-af0ea841fc2a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:29.060726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:29.069062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:29.069691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:29.070002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:29.070290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:29.071052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:29.072783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543adf1-9ef8-4151-9e82-a40e8ef63c39 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:29.099145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:37:28 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:30.747470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58766-c40c-4d1b-9b0d-4611488ed69b None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:30.747988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58766-c40c-4d1b-9b0d-4611488ed69b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:30.748072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58766-c40c-4d1b-9b0d-4611488ed69b None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:30.749392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:30.754564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:30.754981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:30.755128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:30.773776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:30.775918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:30.842795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:30.865415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58766-c40c-4d1b-9b0d-4611488ed69b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:30.909491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:30.970090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58766-c40c-4d1b-9b0d-4611488ed69b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.003611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.004189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.004480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.004767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.015938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8864094c-7e4a-4b2c-8bc3-88e85dc191e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:31.020896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:31.021869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:31.022731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:31.032371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.084677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc683-ca8c-4e2c-ab6d-6b7dd4d49e1e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.084976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc683-ca8c-4e2c-ab6d-6b7dd4d49e1e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.085271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc683-ca8c-4e2c-ab6d-6b7dd4d49e1e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.087293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 26/50] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:37:31.092240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.092538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.092821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.111240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:31.112801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:31.132184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb814-3ac8-4ee3-87e9-dc25284302d3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.143464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:31.169577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.170242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.170553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.170823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.171535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:31.171847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.173229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.180131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 27/51] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:31.184646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 25/52] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:31.190088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.202427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.220947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:31.290518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825820-f799-49ce-abd6-8cc22d1eaee4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.301976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f8b2-1e89-407f-897d-deb7d83ad854 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.324366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.325009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.325299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.325578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.326773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.328220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.329794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 28/53] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:31 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:31.335220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.335345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.335867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.336154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.336434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.338163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.339615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.341163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 26/54] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:31.346513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.388266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:31.431347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:31.434538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d767-e0e4-4add-95b9-9ec830b4a274 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.445187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8380d-dd6c-4d99-a5d0-7054be46d996 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.468638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.469284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.469576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.469889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.471065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.472515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.474413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 29/55] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:31.478580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.479200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.479483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.479761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.480441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.480724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:31.481906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3da87f-cbc1-42b6-a168-0f79d8fab14b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.509529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 27/56] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Jul 26 12:37:31 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:37:31.587269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00353247-6703-4781-afb8-f1f7e1f1000d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:31.623527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:31.624172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:31.624462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:31.624745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:31.625553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.domain.id=default, user.id=e89b70cb0e524eabb8d969a04efaa804) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:31.625898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:31.627371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cfe4-5310-42f9-9aff-f91d017e72b8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:31.634448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 30/57] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Jul 26 12:37:31 2022] GET /identity/v3/role_assignments?user.id=e89b70cb0e524eabb8d969a04efaa804&scope.domain.id=default&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:33.500744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16a06-c503-4265-b7c9-f880194f7942 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:33.501258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16a06-c503-4265-b7c9-f880194f7942 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:33.501341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16a06-c503-4265-b7c9-f880194f7942 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:33.502676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:33.507659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:33.508028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:33.508229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:33.526524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:33.527731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:33.553943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:33.593652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:33.617936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16a06-c503-4265-b7c9-f880194f7942 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:33.706735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:33.717199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16a06-c503-4265-b7c9-f880194f7942 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:33.749652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:33.750317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:33.750598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:33.750925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:33.752021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:33.753456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc0597-7112-4edd-ac2e-063949a24286 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:33.755036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:33.760911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:33.857605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95d88-f18a-41fa-9e8a-2ac6c2752feb None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:33.890396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:33.891009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:33.891293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:33.891571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:33.892258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:33.893700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e7f4-41eb-460f-9605-7efca0dcadbe None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:33.919468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:33 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:37.051671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebddad-09bf-4071-8952-210d4a99c2bc None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.052169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebddad-09bf-4071-8952-210d4a99c2bc None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.052248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebddad-09bf-4071-8952-210d4a99c2bc None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.053861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:37.059870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.060709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.061214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.092308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:37.093856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:37.119380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.132119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d9c4-b02d-415f-b80b-3d13c19eb525 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.132634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d9c4-b02d-415f-b80b-3d13c19eb525 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.133114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d9c4-b02d-415f-b80b-3d13c19eb525 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.137905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:37.144404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.144963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.145454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.180005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:37.181303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:37.203404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:37.246489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.319826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:37.359730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.360126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2be243-1c03-4371-8098-5b81280e91c3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.398121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.399149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.399661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.400153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.411532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:37.417114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:37.418013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:37.418892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:37.421254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 34/66] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:37.427462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.446520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.500022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.512631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9fe7-1225-4e05-a194-ed4074d479f7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.534977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add345-aa55-4f83-9ff4-3d6fb972b49c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.551713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.552483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.552774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.553056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.564632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:37.568869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.569501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-69073066-f2b4-4ddc-9f53-47533e6460c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:37.569615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:37.570482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:37.571811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:37.572398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.572398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.572398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:37.572570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 33/67] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:37.572636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:37.573483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc4b68-f0f6-41ff-9b0d-5cd16d3b71fb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:37.573581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef92-2646-40a7-a31d-3b80d27314ed None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.573581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef92-2646-40a7-a31d-3b80d27314ed None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.573710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef92-2646-40a7-a31d-3b80d27314ed None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.575347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 34/68] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:37.576384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36adf-6f8d-48b3-bd91-d5b03eb5829d None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.576670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36adf-6f8d-48b3-bd91-d5b03eb5829d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.576949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36adf-6f8d-48b3-bd91-d5b03eb5829d None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.578190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 35/69] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:37.578893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff36adf-6f8d-48b3-bd91-d5b03eb5829d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.585898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 35/70] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:37.587967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebac5-3055-4173-b384-46e16ecf3a30 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.589056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebac5-3055-4173-b384-46e16ecf3a30 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.589542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebac5-3055-4173-b384-46e16ecf3a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.613952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-765ebac5-3055-4173-b384-46e16ecf3a30 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:37.615955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-765ebac5-3055-4173-b384-46e16ecf3a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:37.688024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff36adf-6f8d-48b3-bd91-d5b03eb5829d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.688930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.694408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 36/71] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:37.695635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b774508-93ef-4eda-ab33-34fee6e21996 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.696458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b774508-93ef-4eda-ab33-34fee6e21996 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.696736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b774508-93ef-4eda-ab33-34fee6e21996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.713954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1b774508-93ef-4eda-ab33-34fee6e21996 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:37.715153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b774508-93ef-4eda-ab33-34fee6e21996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:37.725731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.726394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.726679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.727473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.728229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:37.728533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:37.729984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:37.738054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 36/72] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:37.738837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.754481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.783955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 37/73] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:37.785221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174165f4-7606-4ad2-84f4-5fc950d4a106 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.785512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174165f4-7606-4ad2-84f4-5fc950d4a106 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.785793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174165f4-7606-4ad2-84f4-5fc950d4a106 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.787075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 38/74] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:37.787773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174165f4-7606-4ad2-84f4-5fc950d4a106 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.852727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f19f2-b8dd-42ce-a42b-fc10063bc59d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.886185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.886832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.887116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.887396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.895599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174165f4-7606-4ad2-84f4-5fc950d4a106 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:37.902140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:37.903598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:37.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:37.910525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:37.923347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:37.929793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:37.931115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.931402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.931682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.941689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b5059bb3-6a38-4157-96ee-206f6d6e3105 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:37.947158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:37.947990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:37.948751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 39/76] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:37.949932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:37.949932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:37.950048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:37.966898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:37.968099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:37.983694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.015998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a9-a1bc-428b-a56f-fb0934aefc85 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.036222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 40/77] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:38.036880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.057318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.058006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.058292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.058568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.059767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.061217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.062848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 38/78] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:37 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.063603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.137931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ee44-1149-4d25-8de8-ea0d17396a06 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.157777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.161961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b92-a618-48d4-bcfd-520ecea0365d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.173178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.173835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.174147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.174431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.185060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:38.190427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:38.191350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:38.192120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 41/79] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:38.192764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.198264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891263-a380-450c-b548-014b9a611795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.198971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891263-a380-450c-b548-014b9a611795 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.199318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891263-a380-450c-b548-014b9a611795 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.199659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891263-a380-450c-b548-014b9a611795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.208887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.268237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891263-a380-450c-b548-014b9a611795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.269714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891263-a380-450c-b548-014b9a611795 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.294835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40090-9713-4b8e-9ee9-00ec2d26c286 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.328941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.329571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.329886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.330193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.330976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:38.331290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.332677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.340902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 42/80] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.341933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.367697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 39/81] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:38.368546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891263-a380-450c-b548-014b9a611795 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.385862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.408677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.442998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427140-9df1-43e9-b0d5-669945a27eed None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.470526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891263-a380-450c-b548-014b9a611795 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.476534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.477705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.478020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.478305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.479448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.480895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.482500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 43/82] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.483254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.505627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.506273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.506555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.506829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.574287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.575738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.583334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0fa1-71ec-42b4-adcc-3ed025d8ba5d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.594068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.613398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.620332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.620956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.621239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.621518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.622262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:38.622574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.623952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.631688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 44/83] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.632468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.677255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 40/84] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:38.678052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.733283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7836268-0e58-406c-b85d-bb4e57e2c6ef None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.766083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.766720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.767007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.767296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.768475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.769966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.771555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 45/85] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.772294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.783236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96c6f6-4769-4741-a0f5-4d38acd71288 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.813826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.819620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.820259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.820541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.820932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.822124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.823560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.825199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 41/86] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.826058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.836087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:38.873197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f20c-e8af-4151-a218-5a720a5eee11 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.907303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.908082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.908376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.908661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.909351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.910830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.927342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936cfc-5a54-40b8-b571-2af714215731 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:38.941835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 46/87] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:38 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:38.941835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:38.964610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:38.965329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:38.965616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:38.965919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:38.967162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:38.968655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:38.970424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 42/88] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:38.971278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.061123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.064548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.071424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239ae7b-ecf8-44c8-a198-b190f2eb0589 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.094257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3b5c-4b26-40e3-a45a-dabd33d3ee6a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.114215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.115125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.115410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.115691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.117956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.119743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.121540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 47/89] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:39.126729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.133036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.134363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.134651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.134930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.218524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.220267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.250805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32851ad-12aa-400c-b6cb-3e7198ee5800 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.295460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.296416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.296809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.297700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.298650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:39.299347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.301926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.309315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.315111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 48/90] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:39.317132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.360267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 43/91] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:39.361308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.383294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.480570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70ca1-8174-4001-9a64-01f543af2573 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.519602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.520398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.525840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.525840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.525840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=e89b70cb0e524eabb8d969a04efaa804) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:39.525840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.525840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.534856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 44/92] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/role_assignments?user.id=e89b70cb0e524eabb8d969a04efaa804&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:39.535549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.558435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5d47-2f56-4021-9449-458c152547a1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.583814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.658052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.659046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.659552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.660019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.665832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff543-2992-4d31-80c9-b93478a48dfd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.704169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938309d-b264-4272-b65a-585e10834225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.704890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938309d-b264-4272-b65a-585e10834225 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.704989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938309d-b264-4272-b65a-585e10834225 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.705203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938309d-b264-4272-b65a-585e10834225 None admin] PATH_INFO: `/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.710634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938309d-b264-4272-b65a-585e10834225 None admin] RBAC: Authorizing `identity:get_project(project_id=7b4d2c582a0746e58e26c38c39f2ed12)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.712206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938309d-b264-4272-b65a-585e10834225 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.715001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 45/93] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:39.721833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938309d-b264-4272-b65a-585e10834225 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:39.793204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.795146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.845835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938309d-b264-4272-b65a-585e10834225 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:39.846979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.861834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:39.885669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:39.886472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:39.887008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:39.887329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:39.888228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=7b4d2c582a0746e58e26c38c39f2ed12, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:39.888646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:39.890260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:39.896607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 46/94] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=7b4d2c582a0746e58e26c38c39f2ed12&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:39.968749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 49/95] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:39.973239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:40.114982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5fed3-a86b-40bd-8aab-3ce2e1a03089 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:40.155406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:40.156079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:40.156368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:40.156654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:40.157939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:40.159435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b2d8-e9bd-4b1f-ac3c-3ddc0a091cbb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:40.161418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 47/96] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:39 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:40.167622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:40.292947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6c7f-01a7-49bf-a1b2-b02408bc32f3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:40.322370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:40.330694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:40.331499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:40.332018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:40.332305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:40.333111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:40.333431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:40.334953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f347d-f75a-4641-9036-e66020544c23 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:40.341226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 50/97] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:40 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=3b97713662114efa802df415a01374b4 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:41.775275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5af9-0652-444b-8ac9-5327fc3a0eba None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:41.775813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5af9-0652-444b-8ac9-5327fc3a0eba None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:41.775889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5af9-0652-444b-8ac9-5327fc3a0eba None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:41.777516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 48/98] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:41.782681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf100b-7d3b-4a8c-9a92-933b977178d0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:41.783091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf100b-7d3b-4a8c-9a92-933b977178d0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:41.783254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf100b-7d3b-4a8c-9a92-933b977178d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:41.804619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-edbf100b-7d3b-4a8c-9a92-933b977178d0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:41.806453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-edbf100b-7d3b-4a8c-9a92-933b977178d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:41.899244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:41.934063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df5af9-0652-444b-8ac9-5327fc3a0eba None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:41.987344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.064472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f05c-8313-4a4b-be22-82058f54e7f6 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.064770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f05c-8313-4a4b-be22-82058f54e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.065266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f05c-8313-4a4b-be22-82058f54e7f6 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.067185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 52/100] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:42.073263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df5af9-0652-444b-8ac9-5327fc3a0eba None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.073675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.074212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.074692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.109655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.110338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.110788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.111213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.113104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:42.114882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:42.132203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:42.138193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:42.139053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:42.139813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:42.143348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 49/101] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:42.150658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.244541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 53/102] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:42.276959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.279450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.284951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40a2a-6f9d-4ab8-a65d-80b7872dc44f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.322206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.322753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.323042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.323425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.324252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:42.324570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:42.326002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:42.335219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 50/103] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:42.341099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.356825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.427383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94f637-2231-432c-ba7f-d5d8f595c638 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.458961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae50ec9-1fcf-4731-b702-5a1efd1311ba None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.484428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.485088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.485380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.485659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.490566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:42.492331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6094af-1ec7-48ea-a701-36fa46da0e3f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:42.494662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 54/104] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:42.495747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abccf3-9654-4acd-8e46-ddc3c8786578 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.496012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abccf3-9654-4acd-8e46-ddc3c8786578 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.496296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abccf3-9654-4acd-8e46-ddc3c8786578 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.497077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.497740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.498069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.498354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] PATH_INFO: `/v3/users/0d32522001a24132accd48b4ae78931f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.498704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 55/105] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:42.502107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abccf3-9654-4acd-8e46-ddc3c8786578 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.520912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] RBAC: Authorizing `identity:get_user(user_id=0d32522001a24132accd48b4ae78931f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:42.522573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa34dd-6593-4472-8a3a-a72f42a76bfc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:42.525133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 51/106] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:42 2022] GET /identity/v3/users/0d32522001a24132accd48b4ae78931f => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:42.526290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.526629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.526916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.550445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:42.551857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:42.567055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.628182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:42.629104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.716803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abccf3-9654-4acd-8e46-ddc3c8786578 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.741467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaefbd-72b2-4860-95d2-87f5ec7ac185 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:42.750106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.778185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.778836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.779150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.779804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.780562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:42.784588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:42.799198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:42.799830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:42.800115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:42.800646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:42.840808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:42.846688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 56/108] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:37:42 2022] POST /identity/v3/projects => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:37:42.847369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:42.909925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:42.911318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04eccf-c4d0-4a0f-8fe1-a565a98483ad None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.010802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688414c0-6203-45af-bdc4-c4892a21de64 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.020234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:43.021326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c622e1-4536-4e2f-b7ae-e042b5fbf800 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.021617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c622e1-4536-4e2f-b7ae-e042b5fbf800 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.021940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c622e1-4536-4e2f-b7ae-e042b5fbf800 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.023245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 54/110] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:43.030856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c622e1-4536-4e2f-b7ae-e042b5fbf800 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.058188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.059274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.059796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.060285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.073028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-9e423e83-5b1a-4fb6-b76e-6aa9acdd881d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:43.079363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:43.080326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:43.081098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:43.083503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 57/111] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:43.085042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.085554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.086063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.107431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:43.109149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:43.135646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.140228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.187968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 58/112] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:43.189136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.205273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c622e1-4536-4e2f-b7ae-e042b5fbf800 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.243355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.244301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.244584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.244859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.246079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:43.247508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c5b11-c68e-4e4f-a931-3e3977b5bdb7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.249174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 55/113] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:43.250391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636918-3a5a-4701-beca-1072bf1f562b None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.250681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636918-3a5a-4701-beca-1072bf1f562b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.250980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636918-3a5a-4701-beca-1072bf1f562b None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.252306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 56/114] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:43.253280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c965c8-9be4-40be-b5a0-5d24c74bfaac None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.253572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c965c8-9be4-40be-b5a0-5d24c74bfaac None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.253978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c965c8-9be4-40be-b5a0-5d24c74bfaac None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.255192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 57/115] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:43.259701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c965c8-9be4-40be-b5a0-5d24c74bfaac None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.304199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe99ed-5c25-4cae-a9b8-cf40943deb13 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.340275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.340903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.341186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.341460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.342208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:43.342513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:43.343908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.357991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 59/116] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:43.357991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.385998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.386294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c965c8-9be4-40be-b5a0-5d24c74bfaac None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.406295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.428490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.429714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.430805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.431822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.443732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-0899ff5e-c5fc-4518-accf-48ddf2ab48cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:43.449008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:43.450083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:43.451010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 58/117] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:43.451792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.451792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.451930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.469749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:43.470980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:43.474762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a210-f8ca-40bd-a793-1d90f351bbe5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.513414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.514303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.514844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.515125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.515923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=0d32522001a24132accd48b4ae78931f) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:43.516238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:43.517784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b4f0c-72d1-4537-965d-a566c7fe4710 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.524097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 60/118] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/role_assignments?user.id=0d32522001a24132accd48b4ae78931f&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:43.525614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.525937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.526218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.546868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:43.548095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:43.554645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 59/119] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:43.556834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.631081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 61/120] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:43.638126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.664020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.719063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0bfa2-2321-49ca-bd44-7851ca6e7031 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.734183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.755777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9ae8-2d40-41eb-8332-a31fb761c7d3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.766848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.768241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.769034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.769530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.771697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:43.774096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.776658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 60/121] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:43.777844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.799443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.800091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.800369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.800651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.801391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:43.801703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:43.803224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:43.816397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 62/122] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:43.821471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.894715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f2177-ae0d-49f5-97f0-e78e1c12139d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.931243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:43.931768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:43.932873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:43.933558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:43.933665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:43.948129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:43.954718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:43.955585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:43.956397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 61/123] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:43.957597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:43.959409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385a26-7ae6-4bf0-92bf-740b0fc55d00 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:43.997910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.012483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.013914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.014665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.015168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.030936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:44.039887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:44.040790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:44.041576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:44.048540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 63/124] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:44.048540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.076733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9843-fdf4-4ee3-8634-2fd9f9e25bf0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.112803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.113452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.113738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.114095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.115556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.117066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.119521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 62/125] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:43 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.120294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.179062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221001-42e4-411e-9717-ed2d76206aa3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.219425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.220090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.220430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.220722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.222101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.223593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.225433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 64/126] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.226249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.243617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.255455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2816a-a73b-499e-9000-b74386166b6f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.257737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.308209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.308840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.309130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.309456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.310241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:44.310609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.311978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.321052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 63/127] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.321982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.351710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a3959-c559-44fe-bb43-f9e5222e5127 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.387454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.388309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.388745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.389173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.390064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:44.390517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.392055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.400513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 65/128] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.405978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.431224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1129027-c2f7-48b3-9524-6d297abc0e56 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.467971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.468710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.468996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.469479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/users/3b526510f605469fa3a323c8954b9ded/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.471406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, user_id=3b526510f605469fa3a323c8954b9ded, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.472974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.480947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.491765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 64/129] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:44 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/users/3b526510f605469fa3a323c8954b9ded/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:37:44.497720 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.517743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b63c-567b-4171-9c96-8ca17ca9ae58 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.543616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.557697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.559236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.559790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.560295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.561743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.564118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.566069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 66/130] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.567022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.681930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5207-dc08-498b-91a5-219ed7fffd91 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.702838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5bba-ffc3-487c-bedf-57329c619664 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.743093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.744229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.744691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.745131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.746608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.748291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.750161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 67/131] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.751190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.751318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.756121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.756121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.756121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.757382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.759702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.761921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 65/132] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.766792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.767661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.874314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1dcdc-7b7e-4e36-bf0e-e0396a97c612 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.910827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:44.913938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.914942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.915558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.915984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/users/e89b70cb0e524eabb8d969a04efaa804/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.918918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, user_id=e89b70cb0e524eabb8d969a04efaa804, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.919998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce74ad-5492-4c06-8cdb-0b0eb807746c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:44.920744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.937364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 68/133] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:44 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/users/e89b70cb0e524eabb8d969a04efaa804/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:37:44.938453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:44.971233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:44.971984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:44.972267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:44.972610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:44.978942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:44.980532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:44.982257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 66/134] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:44.988624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:45.016522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:45.059697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa293-1e9f-4ae7-a0b0-a843cae326a4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:45.097982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:45.098877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.099173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.099457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] PATH_INFO: `/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.100746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7b4d2c582a0746e58e26c38c39f2ed12)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:45.102790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:45.104813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 69/135] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:44 2022] GET /identity/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:45.110731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:45.156360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53370-fcc5-4208-a0be-b5edd4da6309 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:45.219091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:45.219790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.220068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.220352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/users/3b526510f605469fa3a323c8954b9ded/roles/3b97713662114efa802df415a01374b4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.225434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29b73e-e674-4e97-819a-ced40fd3b4f1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:45.226618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, user_id=3b526510f605469fa3a323c8954b9ded, role_id=3b97713662114efa802df415a01374b4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:45.228384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fff77-d6af-4db4-a70d-962005aa9d3a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:45.257062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 67/136] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:44 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/users/3b526510f605469fa3a323c8954b9ded/roles/3b97713662114efa802df415a01374b4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:37:45.265944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:45.266659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.266947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.267229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] PATH_INFO: `/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12/users/3b526510f605469fa3a323c8954b9ded/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.269415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b4d2c582a0746e58e26c38c39f2ed12, user_id=3b526510f605469fa3a323c8954b9ded, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:45.270964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a56613-2d58-4c0c-bb01-a5702e406707 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:45.273402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:45.287765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 70/137] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:45 2022] PUT /identity/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12/users/3b526510f605469fa3a323c8954b9ded/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:37:45.314073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92bf2-1149-4ae7-b02f-3e04786d24e2 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.314745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92bf2-1149-4ae7-b02f-3e04786d24e2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.315245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92bf2-1149-4ae7-b02f-3e04786d24e2 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.316964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 68/138] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:45.324424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.324739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.324999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.348738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:45.350075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:45.446803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 71/139] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:45.471911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92bf2-1149-4ae7-b02f-3e04786d24e2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:45.514713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:45.627043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92bf2-1149-4ae7-b02f-3e04786d24e2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:45.665282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:45.665958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.666243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.666520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.669867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:45.671311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdeaf7-65df-4684-b750-e72121ddf3ae None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:45.673134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 69/140] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:45.683002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:45.815318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e3a2-7d8b-47f3-817b-dc1387068e3f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:45.846212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:45.854822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:45.855484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:45.855775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:45.856057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:45.856763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:45.858249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d70b7-d00e-4f74-9627-fb0a04bb8ccf None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:45.891503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 72/141] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:45 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:46.003246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793aad-b632-492b-9b61-43da5082c388 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.003752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793aad-b632-492b-9b61-43da5082c388 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.003855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793aad-b632-492b-9b61-43da5082c388 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.005151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 70/142] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:46.011306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.011596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.011880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.040353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:46.046056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:46.136326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 73/143] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:46.158771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57793aad-b632-492b-9b61-43da5082c388 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:46.285065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:46.298368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57793aad-b632-492b-9b61-43da5082c388 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:46.338642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:46.339326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.339609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.339890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.358532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:46.364060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:46.365228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:46.366073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 71/144] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:46.374857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:46.561675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760366-c7d0-4e93-995a-10039866b4c1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:46.581250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:46.610919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:46.611549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.611831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.612103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.612824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:46.613130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:46.614526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:46.629282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 74/145] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:46.635603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:46.752958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ae23-a317-4cc2-b17d-77c1918ad284 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:46.797941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:46.798609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.798887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.799158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] PATH_INFO: `/v3/users/0d32522001a24132accd48b4ae78931f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.800356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0d32522001a24132accd48b4ae78931f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:46.802569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:46.804415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 72/146] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:46 2022] GET /identity/v3/users/0d32522001a24132accd48b4ae78931f => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:46.811594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:46.950272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98719d6a-d860-47b3-b566-9c8ae902458c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:46.985203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:46.985869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:46.986154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:46.986427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:46.990545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:46.992012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c2c5-14f0-40db-953f-06e36d72813f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:46.993717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 75/147] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:46 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:47.000029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:47.025279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:47.128174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3d07-f5e4-48e9-8ec0-3366b254c2f1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:47.167881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:47.168562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:47.168841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:47.169115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/users/0d32522001a24132accd48b4ae78931f/roles/11ba93a8f8af493ab35d6dd60c8adc0f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:47.171120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, user_id=0d32522001a24132accd48b4ae78931f, role_id=11ba93a8f8af493ab35d6dd60c8adc0f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:47.172560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cae649-c3de-407f-9b1d-964d95899135 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:47.190255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 73/148] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:46 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/users/0d32522001a24132accd48b4ae78931f/roles/11ba93a8f8af493ab35d6dd60c8adc0f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:37:48.006265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1513-29b3-4d05-a8c1-dbc7210c42a2 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.006808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1513-29b3-4d05-a8c1-dbc7210c42a2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.006808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1513-29b3-4d05-a8c1-dbc7210c42a2 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.008685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 76/149] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:48.014013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7294a8-4ffb-43db-b449-9d13c87edc90 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.014465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7294a8-4ffb-43db-b449-9d13c87edc90 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.014900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7294a8-4ffb-43db-b449-9d13c87edc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.038862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1a7294a8-4ffb-43db-b449-9d13c87edc90 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:48.041976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1a7294a8-4ffb-43db-b449-9d13c87edc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:48.128071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 74/150] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:48.162752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b1513-29b3-4d05-a8c1-dbc7210c42a2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:48.212307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:48.280981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b1513-29b3-4d05-a8c1-dbc7210c42a2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:48.283243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ea27-b3cb-455a-a96e-291dc18ce135 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.283528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ea27-b3cb-455a-a96e-291dc18ce135 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.283802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ea27-b3cb-455a-a96e-291dc18ce135 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.285139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 75/151] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:48.291100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716c8c-4534-4841-89b8-647f22b04b61 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.291406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716c8c-4534-4841-89b8-647f22b04b61 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.291648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716c8c-4534-4841-89b8-647f22b04b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.310217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:48.318326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-67716c8c-4534-4841-89b8-647f22b04b61 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:48.319513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-67716c8c-4534-4841-89b8-647f22b04b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:48.373090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:48.373742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.374052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.374327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.393281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a698519f-a689-41e5-a7b8-2d9d16f00a4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:48.399956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:48.400830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:48.402249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 77/152] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:48.406544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e596-d7ad-433c-a4db-da1cecbd016a None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.406831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e596-d7ad-433c-a4db-da1cecbd016a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.407108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e596-d7ad-433c-a4db-da1cecbd016a None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.408439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 78/153] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:48.409144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0e596-d7ad-433c-a4db-da1cecbd016a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:48.479269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 76/154] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:48.480534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.480821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.481094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.516028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:48.517204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:48.606208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:48.608780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0e596-d7ad-433c-a4db-da1cecbd016a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:48.685218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:48.686286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.686787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.687276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.688217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:48.688770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:48.690474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:48.702408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 79/155] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:48.703416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:48.739144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 77/156] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:48.740276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:48.836885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:48.893546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503767f-797c-4815-b644-1e91ff278ee2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:48.910988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c48-868e-4410-96cb-00c0085c4129 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:48.955208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:48.956154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.956588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.957011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:48.962551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:48.964213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:48.966058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 78/157] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:48 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:48.966959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:48.983486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:48.984371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:48.984801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:48.985246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.002221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:49.007857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:49.009955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:49.011003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:49.013258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 80/158] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:37:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:49.019024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:49.095499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:49.211493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb26-9cc9-4732-817a-7a0d31eaf579 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:49.238149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcde8-9218-417e-b791-f062e9318c4f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:49.261350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:49.262006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.262294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.262576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.314537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:49.315201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.315489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.315768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.317849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:49.342805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-308d9f2a-0ac1-4de4-a57a-a58861ad0770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:49.348088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:49.349015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:49.349896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 79/159] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:49.350569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca9e-664f-4ff1-af6b-5b76cffd6c03 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.353237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca9e-664f-4ff1-af6b-5b76cffd6c03 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.353237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca9e-664f-4ff1-af6b-5b76cffd6c03 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.353237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 80/160] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:49.361990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feca9e-664f-4ff1-af6b-5b76cffd6c03 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:49.381385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:49.382907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:49.416284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:49.577484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 81/161] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:49.578097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:49.599740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feca9e-664f-4ff1-af6b-5b76cffd6c03 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:49.686215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:49.686850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.687132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.687407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.688143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:49.688451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:49.689900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81eef6-eba6-41bb-953a-5d03ca930857 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:49.716052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 81/162] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:37:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:49.717139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.717430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.717710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.761985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:49.763175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:49.817573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dac1-6da6-48de-84a8-f28413c43a68 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:49.857473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:49.874164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:49.883286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 82/163] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:49.887909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:49.907923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:49.908568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:49.908853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:49.909184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:49.909947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:49.910312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:49.911713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:49.933289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 82/164] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:49.937336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.116343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5a72-0524-4d52-9924-39e1da14b3f9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.159292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf316-26b8-41d0-afe9-6b09c58d7b6b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.203656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.204552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.204983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.205568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.206989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.208619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:50.210485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 83/165] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:49 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:50.216294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.230557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.231227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.231531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.231783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.234530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.236002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:50.237713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 83/166] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:49 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:50.238484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.291852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:50.327788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad8cf-0bcf-40ed-999c-f9a172c9b602 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.365486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.366484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.367221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.367844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] PATH_INFO: `/v3/users/e89b70cb0e524eabb8d969a04efaa804` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.369198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e89b70cb0e524eabb8d969a04efaa804)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.371314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7b1c6-3487-4bb9-bb16-38373cfd68f6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:50.373102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 84/167] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/users/e89b70cb0e524eabb8d969a04efaa804 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:50.374845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ecf5-6e54-4b86-9ba7-da6a740760d1 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.375303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ecf5-6e54-4b86-9ba7-da6a740760d1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.375729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ecf5-6e54-4b86-9ba7-da6a740760d1 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.377096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 85/168] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:50.378093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ecf5-6e54-4b86-9ba7-da6a740760d1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.458255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:50.494806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ecf5-6e54-4b86-9ba7-da6a740760d1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.530173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:50.537138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.538059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.538379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.539055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.542019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05325bbe-fff3-4ec1-8241-9c826bccdb53 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.579975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.580737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.581093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.581441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.594168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:50.599651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:50.600566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:50.601382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:50.602416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 84/169] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:50.606701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.625918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.628127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:50.716880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedc60-5cbe-4ea1-a516-30e3aeb0b5db None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.733596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:50.744250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 86/170] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:50.745288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.761098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.761714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.762029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.762306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.763097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:50.763406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.764837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734163-a177-473b-a140-4a4f1eb67cb9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:50.768005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:50.771376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 85/171] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:50.775234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e421-3e74-497a-88e6-0d3af9288ba5 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.775523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e421-3e74-497a-88e6-0d3af9288ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.775803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e421-3e74-497a-88e6-0d3af9288ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.795262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8a09e421-3e74-497a-88e6-0d3af9288ba5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:50.796505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8a09e421-3e74-497a-88e6-0d3af9288ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:50.858252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c67a9-dddd-4819-a2c1-f282363b9093 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:50.874149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 86/172] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:50.882150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b3a4-6655-4f56-972a-31440eee40be None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.882150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b3a4-6655-4f56-972a-31440eee40be None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.882150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b3a4-6655-4f56-972a-31440eee40be None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.882150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 87/173] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:50.882150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b3a4-6655-4f56-972a-31440eee40be None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:50.906262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:50.907041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:50.907390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:50.907738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:50.990609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:50.992077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70394e-e7bb-4c74-ae8c-e35d628f11c0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.002661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b3a4-6655-4f56-972a-31440eee40be None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.012401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.013445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.038570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.039830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.040167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.040443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.041491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:51.041491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.042834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e700-9aa8-4503-bd3d-0ac05c5981c0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.051292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 88/174] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.051292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b794-47e4-47b0-ae22-1410d6e06a2c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.051292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b794-47e4-47b0-ae22-1410d6e06a2c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.051292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b794-47e4-47b0-ae22-1410d6e06a2c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.056137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 89/175] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:51.057107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c86f0-6db5-43ed-bfe6-d2ce5595890b None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.057387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c86f0-6db5-43ed-bfe6-d2ce5595890b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.057661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c86f0-6db5-43ed-bfe6-d2ce5595890b None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.058883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 90/176] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:51.062681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c86f0-6db5-43ed-bfe6-d2ce5595890b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.101551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 87/177] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:51.103448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.103754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.104032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.121638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:51.122874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:51.166252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c86f0-6db5-43ed-bfe6-d2ce5595890b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.189176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 88/178] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:51.190037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.200143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.201365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.201646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.201953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.203135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.204557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.211164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 91/179] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.211164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.245171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.247906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.296265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82945d26-36e0-4eb9-bb55-e5355283054b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.308015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5916-b9ae-4375-acf6-ac2d13fb310b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.329526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.330193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.330476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.330761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.341127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:51.341997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.342630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.342911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.343186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] PATH_INFO: `/v3/users/3b526510f605469fa3a323c8954b9ded` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.344345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b526510f605469fa3a323c8954b9ded)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.345773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281a04-0013-491a-ae67-f781ef2a72d7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2e1fd869-12ad-4b4a-bf91-b09da0173c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:51.346068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:51.346991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:51.347810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 89/180] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:51.348470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.348594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.348933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.352788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 92/181] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/users/3b526510f605469fa3a323c8954b9ded => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.355087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.355382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.355667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.367554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:51.368732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:51.373251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:51.374429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:51.435759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 90/182] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:51.436793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.451755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 93/183] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:51.454699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.490992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.493243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.553614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c524a0-1ed8-4ee6-b094-793e488d54ed None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.556297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5fbc4-bc05-44c1-a382-6a588c94a4a4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.587502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.588147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.588436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.588719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.589150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.589779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.589909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.590087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.590361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.591339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.593009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 91/184] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.593771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.601589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:51.607131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:51.608194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 94/185] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:51.609178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.696325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320d82-542f-4c1e-812b-fcde64198403 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.703397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.705496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.709614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9724ec-71c4-4c07-9b2c-ccdcdcc46a65 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.732953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.733575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.733885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.734170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.734964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:51.735385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.736724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.743461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 92/186] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=3b97713662114efa802df415a01374b4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.744248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.744659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.745285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.745569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.745877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.746642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:51.746903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.748404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:51.762208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 95/187] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:51.762208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.869551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69190699-b2c8-440f-9346-d5613cfeae62 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.876743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806ac2-6410-4189-a6e1-547adf36a9bd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:51.909234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.909902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.910192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.910475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.917650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:51.918352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:51.918613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:51.918889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:51.931818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:51.937264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:51.938203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:51.939010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:51.939608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 96/188] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:51.940233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:51.963109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.967640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:51.997613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:51.999119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.047106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8dd46-d03b-4b25-a502-fa829af74be0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.080567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.081210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.081493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.081765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.082921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.084376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.091048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 97/189] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.091048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.105082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 93/190] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:52.105947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.172631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.174432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.188029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd672ac-6a9c-470a-93cd-00b1d21d8db3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.205001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32d58-3562-41a6-b4bd-1f8f5efb414e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.220841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.221388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.221672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.221980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.222766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=e89b70cb0e524eabb8d969a04efaa804) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:52.223073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.224498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.230554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 98/191] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/role_assignments?user.id=e89b70cb0e524eabb8d969a04efaa804&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.231169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.252646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.253396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.253684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.254006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.254755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:52.255075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.256532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.266754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 94/192] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.267545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.345894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca4ea-b52c-4646-b71a-ea60c11743d4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.383257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66dc-f786-4e96-8106-541123b152a3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.386163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.388055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.388055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.388055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.403001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.404480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.406506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 99/193] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.407159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.418908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.430820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.431885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.432171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.432747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.433170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:52.433482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.434939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.437259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.445721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 95/194] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.446684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.525464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6b73-ad94-49fb-b807-83c8e55d1591 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.548509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58521be-64e5-4e5d-8c50-91eca4763362 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.559847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.560461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.560739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.561007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.561685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.563152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.582991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.583686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.583972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.584251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] PATH_INFO: `/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.585512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] RBAC: Authorizing `identity:get_project(project_id=7b4d2c582a0746e58e26c38c39f2ed12)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.587170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.588871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 96/195] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/projects/7b4d2c582a0746e58e26c38c39f2ed12 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.589630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.609918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 100/196] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:52 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:52.609918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.660944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.668605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.709956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c9b2f-2674-4764-8a52-f6b168ffec24 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.712790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3257c-4e0c-4275-b6b7-30d2aa925582 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.751193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.751963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.752252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.752590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.753767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.754875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.755269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.755564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.755850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.756124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.757035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 97/197] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.760912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.844287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.846610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.889165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff9d9-03dc-48e1-8c5f-14f13f8ec9dc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:52.923463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.926806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:52.934537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:52.935190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:52.935498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:52.935752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] PATH_INFO: `/v3/users/0d32522001a24132accd48b4ae78931f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:52.937874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d32522001a24132accd48b4ae78931f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:52.939331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:52.940955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 98/198] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/users/0d32522001a24132accd48b4ae78931f => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:52.941717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:52.981123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 101/199] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:52.982322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.067872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13fca-8ff5-45ec-9f4f-8c531bf2d9b3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.109187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.109753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.110268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.110549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.112019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=7b4d2c582a0746e58e26c38c39f2ed12, user.id=3b526510f605469fa3a323c8954b9ded) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:53.112337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.114453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.117182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236a27-7a8c-4d2a-8501-b3b4e4ba3fe6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.123641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 99/200] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/role_assignments?user.id=3b526510f605469fa3a323c8954b9ded&scope.project.id=7b4d2c582a0746e58e26c38c39f2ed12&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:53.124621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.177707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.178387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.180845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.181132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.234900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.246211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.316817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398cdf-2cb9-492f-be42-8c17b128f25e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.319498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.321622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.362138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.362697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.362981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.363257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.439230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.439422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 102/201] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:53.440357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.446468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.512495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.514197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.556575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e85c-4bd7-4049-9346-6e2e4d0d7d7b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.557358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 100/202] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:53.558262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.599738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.600402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.600683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.600953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.602484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.605352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.607082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 103/203] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:53.607919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.673041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230325e-a087-4ed8-9ab1-e9deeac45e09 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.718034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.718998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.719289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.719570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.720215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9def-195b-4164-a84f-cda5c5594a5f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.720787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.723393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.725092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 101/204] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:53.725872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.757461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.764593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.765337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.765619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.765916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.767202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.768095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:53.769778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.771571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 104/205] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:53.780398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.845243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a187-64ff-4a75-a15b-452eab553bfa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.884813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.885704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.886025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.886402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.887228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=731f936bbf9440209371017bcf339ef8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:53.887545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.889048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.895842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 102/206] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/role_assignments?user.id=731f936bbf9440209371017bcf339ef8&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:53.896808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:53.903484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154fd03-ee5c-4b64-8dd8-344c8a4b6c89 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:53.949463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:53.950064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:53.950342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:53.950616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:53.951513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=731f936bbf9440209371017bcf339ef8) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:53.951920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:53.953366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95e363-41e3-4bae-ab06-4a8acd057457 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:53.965828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 105/207] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/role_assignments?user.id=731f936bbf9440209371017bcf339ef8&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=3b97713662114efa802df415a01374b4 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:54.070417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:54.085122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f25d-1f4e-420e-943b-3a683e2abf9a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:54.147175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:54.147835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:54.148127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:54.148410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:54.149788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, scope.project.id=214bbbb187114431a614cb0adfb5275f, user.id=0d32522001a24132accd48b4ae78931f) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:54.150172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:54.151666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39d461-1933-47d3-9d08-f709acf276dd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:54.166319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 103/208] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:53 2022] GET /identity/v3/role_assignments?user.id=0d32522001a24132accd48b4ae78931f&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:54.975875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e584-554a-4a8a-88ef-85abd57cd0ac None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:54.976423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e584-554a-4a8a-88ef-85abd57cd0ac None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:54.976423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e584-554a-4a8a-88ef-85abd57cd0ac None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:54.978613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 106/209] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:54.983919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:54.984705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:54.985174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.004550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:55.006064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:55.073420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:55.091723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ab471-de79-494b-9b3a-7b060918c9de None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.092266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ab471-de79-494b-9b3a-7b060918c9de None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.092725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ab471-de79-494b-9b3a-7b060918c9de None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.094289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 107/211] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:55.096604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.099935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.100221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.100496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.127368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:55.129034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:55.196601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:55.210143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ecc7-1706-472d-8034-4418a88f3fd6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.224021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:55.229940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 108/212] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:55.256794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.260577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.262569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.262956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.263312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.278576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:55.285613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:55.286558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:55.287374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 105/213] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:55.294163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.370798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b490-4f54-4ec0-8a6e-c05dc5c931f8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.412319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.412976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.413261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.413541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.415687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:55.417150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:55.419981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 109/214] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:55.425651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.439523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedfcd-0a8d-4e9d-872f-8a284f7ac5a2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.492102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.493631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.494480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:55.494904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.496499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.497635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:55.498244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:55.500028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:55.514668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 106/215] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:55.521048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.538708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:55.556291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa134a7-4e83-464f-b776-ea2f25670240 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.594695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.595275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.595559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.595837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.596523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:55.598223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:55.628474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 110/216] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:55 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:37:55.646037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cde-cc00-4287-845b-d15407cc00e8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.684403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.685476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.686004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.686474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] PATH_INFO: `/v3/users/f5766dc426a84857bed3dd1b2200c536` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.702768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] RBAC: Authorizing `identity:get_user(user_id=f5766dc426a84857bed3dd1b2200c536)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:55.704669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:55.706989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 107/217] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:55 2022] GET /identity/v3/users/f5766dc426a84857bed3dd1b2200c536 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:55.713305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:55.834165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db61f-6831-4841-8682-ff33dac95e53 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:55.853746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:55.874557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:55.875506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:55.875979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:55.876441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:55.953045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:55.954872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25786899-6372-4fdf-98c5-2f0cdfa93065 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:56.089916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 111/218] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:56.095505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.134756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69fa4-c80b-4617-a62f-fd32b1b1a9e2 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.135065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69fa4-c80b-4617-a62f-fd32b1b1a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.135363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69fa4-c80b-4617-a62f-fd32b1b1a9e2 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.136726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 112/219] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:56.141775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.142109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.142383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.169982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:56.171182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:56.192680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.249749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.298365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 113/220] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:56.303541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876442-c9f7-43be-a3de-7a1917f4119c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.347434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.348001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.348279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.348551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.350701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.354836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:56.362575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:56.365949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 108/221] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:56.372532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.468601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2e064-4a00-4e32-b602-4133f3e23561 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.487258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8678-f3a3-4a9d-9d36-8d3d193f326e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.503980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.504637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.504926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.505184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.516338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-36902c31-5e40-4639-84de-913d40aa8cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:56.521392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:56.522351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:56.523168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 114/222] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:56.524772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222acf97-77f8-49b6-9d80-49899d18a6b9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.525064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222acf97-77f8-49b6-9d80-49899d18a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.525361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222acf97-77f8-49b6-9d80-49899d18a6b9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.529344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.530253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.530736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.530972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 115/223] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:56.531420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.531783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222acf97-77f8-49b6-9d80-49899d18a6b9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.532740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=f5766dc426a84857bed3dd1b2200c536) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:56.533272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:56.535262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ecaee-db87-4eeb-b83c-4d5f107ad3c8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:56.542334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 109/224] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/role_assignments?user.id=f5766dc426a84857bed3dd1b2200c536&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:56.544309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.545188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446004-1571-412c-8bab-823b15463302 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.545723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446004-1571-412c-8bab-823b15463302 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.546339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446004-1571-412c-8bab-823b15463302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.554375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.568829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7b446004-1571-412c-8bab-823b15463302 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:56.570813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7b446004-1571-412c-8bab-823b15463302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:56.645079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222acf97-77f8-49b6-9d80-49899d18a6b9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.649678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 110/225] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:56.683891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b446004-1571-412c-8bab-823b15463302 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.686113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.686737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.687022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.687295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.688017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:56.688322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:56.689705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:56.699609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 116/226] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:56.709661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.823931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b446004-1571-412c-8bab-823b15463302 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.831105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.880225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:56.890697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.891850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.892877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.893504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.895569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ff3d-717f-419f-92d4-e1156cda7d4b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:56.915043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:56.926153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:56.927041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:37:56.927836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:56.932364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 111/227] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:37:56.940255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:56.974124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:56.975149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:56.976470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:56.977703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:56.979969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:56.983382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:56.987875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 117/228] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:37:56.996775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:57.118522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a62a4-5501-474a-af25-75e934a9ecc9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.159410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd58da-140c-40bf-a4fa-a1af480249f5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.165608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.167455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.171104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.171602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.173063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.179018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.181147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 118/229] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:57.191534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:57.213578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.214597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.215099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.215598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.216507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:57.217054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.218144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:57.218886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.229043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 112/230] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:37:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:57.234702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:57.299690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:57.368150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ab22-1b2c-4337-ad96-46fae42ee4ba None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.385581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d44e6-3819-4295-abef-692138f2d01f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.413784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.414619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.414908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.415191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/users/731f936bbf9440209371017bcf339ef8/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.421832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, user_id=731f936bbf9440209371017bcf339ef8, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.421832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.434648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 119/231] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:57 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/users/731f936bbf9440209371017bcf339ef8/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:37:57.446466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.447148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.447475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.447780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.449207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.450897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.453171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 113/232] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:57 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:57.460794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:57.565822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:57.614287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a6c3c-1354-4441-b543-39814c358c8e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.659441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.660091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.660375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.660648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.662581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.664896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5de33-62aa-4944-8f3c-59044686db40 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.667237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 120/233] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:57 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:57.673171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:57.826674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfd3ad-2136-4a65-b1d4-a3a11043ee79 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:57.856672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:57.872296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:57.872825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:57.873166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:57.873450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/users/731f936bbf9440209371017bcf339ef8/roles/3b97713662114efa802df415a01374b4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:57.878335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, user_id=731f936bbf9440209371017bcf339ef8, role_id=3b97713662114efa802df415a01374b4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:57.879818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b66f-f720-4314-93d4-bcf8166a300f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:57.902287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 114/234] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:37:57 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/users/731f936bbf9440209371017bcf339ef8/roles/3b97713662114efa802df415a01374b4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:37:58.131470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594588-9af4-4fa9-a9e5-c9256f6b66b6 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.132433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594588-9af4-4fa9-a9e5-c9256f6b66b6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.133397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594588-9af4-4fa9-a9e5-c9256f6b66b6 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.135055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 121/235] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:58.140733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.141028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.141310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.166948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:58.168158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:58.250410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 115/236] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:37:58.272906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0594588-9af4-4fa9-a9e5-c9256f6b66b6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:58.408129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0594588-9af4-4fa9-a9e5-c9256f6b66b6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:58.444469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:58.445126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.446057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.446332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.448224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:58.459021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:58.464154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:58.465049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:37:58.465876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 122/237] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:58.472576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:58.579827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2199fc-c082-4834-80f6-cda24f09f050 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:58.596018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:58.624486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:58.625119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.625402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.625674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.626432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:58.626739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:58.628128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c53be-609d-4e22-88bb-9a5b7c3a079a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:58.636746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 116/238] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:58.642086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:58.727058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc7910-ec5d-4023-a379-6f134512e64e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.727226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc7910-ec5d-4023-a379-6f134512e64e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.727534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc7910-ec5d-4023-a379-6f134512e64e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.729258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 117/239] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:37:58.734180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.734468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.734752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.748512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f63ec-0722-403b-aff5-4c4a4797e2ef None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:58.753523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:58.754809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:58.787636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:58.788308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:58.788675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:58.789467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] PATH_INFO: `/v3/users/4a0ae71f6b3946c2829153fe101db6cb` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:58.812798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] RBAC: Authorizing `identity:get_user(user_id=4a0ae71f6b3946c2829153fe101db6cb)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:58.814303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:58.816002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 123/240] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:58 2022] GET /identity/v3/users/4a0ae71f6b3946c2829153fe101db6cb => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:58.825615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:58.882357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 118/241] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:58.910222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:58.926793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:58.961348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6e3fe-aa7e-4b75-a891-19ca383a3353 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.001143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.001691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.002021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.002327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.050793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cf812-5049-4f15-bffd-6530f70fb217 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.066177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.084489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.086704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.088729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.089509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.090433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.090433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.091610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.093135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8dae1-dd0f-445d-925f-5a708c074a50 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.095242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 119/242] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:59.096274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dcea-8bb8-43f0-b9cf-3fdb264037f0 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.096653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dcea-8bb8-43f0-b9cf-3fdb264037f0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.097080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dcea-8bb8-43f0-b9cf-3fdb264037f0 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.098673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 120/243] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:37:59.104302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.104948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.105369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.130066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:37:59.131385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:37:59.148050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.207487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 124/244] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:37:59.208725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.220329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 121/245] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:37:59.221769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.326446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82262e-34ec-48cf-b4e8-c0f06bbe1593 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.346062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb0034-7f15-4ce0-be7b-0e4686d8cc91 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.347944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.375578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.376590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.377397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.377780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.378884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.381159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.386117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.386977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.387409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.387836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.389164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.390935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.394379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 122/246] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:37:59 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:59.395791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.417445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 125/247] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:37:59 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:37:59.419114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.435779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.551015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea132ea-bf59-43df-a4d9-16996986c09f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.561122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabb44-9859-4562-b584-7bcc60141dfe None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.606540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.607620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.608181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.608468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.609591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=4a0ae71f6b3946c2829153fe101db6cb) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:59.609932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.611403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.618939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 126/248] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:37:59 2022] GET /identity/v3/role_assignments?user.id=4a0ae71f6b3946c2829153fe101db6cb&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:59.639486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.640163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.640452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.640734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.655763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:37:59.660974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:37:59.662101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:37:59.662905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 123/249] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:37:59.668405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.764391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.802580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365e50-12d9-4731-b6fc-a81a3a2a671e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:37:59.841858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:37:59.842487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:37:59.842770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:37:59.843045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:37:59.843771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:37:59.844076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:37:59.845455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c236-8a8d-49c5-9c5d-5842f2c70493 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:37:59.854636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 127/250] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:37:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:37:59.860461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:37:59.899784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:37:59.969337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df135-df99-4647-a274-461446b8fa04 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:00.006556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:00.007211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.007496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.007818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] PATH_INFO: `/v3/users/f5766dc426a84857bed3dd1b2200c536` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.009871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ee70-ac39-4eaa-a5e5-a1533b6a389f None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.010168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ee70-ac39-4eaa-a5e5-a1533b6a389f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.010446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ee70-ac39-4eaa-a5e5-a1533b6a389f None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.010848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] RBAC: Authorizing `identity:get_user(user_id=f5766dc426a84857bed3dd1b2200c536)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:00.011989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 128/251] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:00.012323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:00.014975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 124/252] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:37:59 2022] GET /identity/v3/users/f5766dc426a84857bed3dd1b2200c536 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:00.019336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.019706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.019993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.027902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:00.042604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:00.043935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:00.136072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 129/253] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:00.154179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9d76-a37d-4eb7-aab9-c7faf1453c6d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:00.158142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:00.161453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:00.200761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:00.201429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.201710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.202924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.204140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:00.205712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:00.207449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 125/254] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:00 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:00.214674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:00.251299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:00.339760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae600-cde6-4837-b683-d186fe6328d4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:00.428361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed441-82cd-47a4-828b-26c422a040f8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:00.434135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:00.435060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.435543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.436033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.466002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:00.471418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:00.472307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:00.473145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:00.476502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 130/255] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:00.482844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:00.527849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:00.529079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.530441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.531090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/users/f5766dc426a84857bed3dd1b2200c536/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.538667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, user_id=f5766dc426a84857bed3dd1b2200c536, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:00.540539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:00.568012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 126/256] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:00 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/users/f5766dc426a84857bed3dd1b2200c536/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:00.689743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f760713-2997-4038-83d4-66ba96d8edf6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:00.735050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:00.754625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:00.755719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.756231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.756741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.757769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:00.758678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:00.760307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41d6b2-5833-4e6e-8160-68c42dff9bd3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:00.769732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 131/257] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:00.775782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:00.828417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:00.871803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0f8b-bc69-4958-b79b-85b5449c3ddc None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.872442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0f8b-bc69-4958-b79b-85b5449c3ddc None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.872951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0f8b-bc69-4958-b79b-85b5449c3ddc None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.875618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 132/258] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:00.879696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:00.880228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:00.880714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:00.916377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:00.917977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:00.941077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16317-70f5-42f0-a18c-f5eb69450707 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.006634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.007332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.007594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.008413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.009674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:01.011160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:01.013073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 127/259] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:00 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:01.018225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.034876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 133/260] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:01.066923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.199724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b66b-d2fa-4493-ae10-37c196234c8f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.202910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:01.253398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.254062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.254352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.254630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.342220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:01.343965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:01.439857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91ae01-8544-43be-9e70-57dd064fe16e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.449900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:01.458902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 128/261] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:01.464690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.479698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:01.513209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.513897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.514181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.514455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.531193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:01.536221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:01.537117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:01.538707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 134/262] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:01.545155 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.608902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8139-559f-4e92-b364-afa15c6cf951 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.676769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.677427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.677710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.678033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.679274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:01.680872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:01.682601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 129/263] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:01.688294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.740143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff87-7e60-4fc7-9bab-594699f47828 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.794526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:01.800176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.800813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.801097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.801376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.802134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:01.802444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:01.803819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:01.817375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 135/264] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:01.818747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:01.882176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:01.891801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d939f08-54cb-47b7-b56d-e6f50763912e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:01.962789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:01.963786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:01.964274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:01.964753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:01.965771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=731f936bbf9440209371017bcf339ef8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:01.966336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:01.967975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:01.982650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 130/265] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/role_assignments?user.id=731f936bbf9440209371017bcf339ef8&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:02.008136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240e5ec-73cd-4393-b871-e1d9e2a5255c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:02.087080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:02.087754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.088036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.088314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] PATH_INFO: `/v3/users/731f936bbf9440209371017bcf339ef8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.089569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] RBAC: Authorizing `identity:get_user(user_id=731f936bbf9440209371017bcf339ef8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:02.091075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:02.093152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 136/266] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:01 2022] GET /identity/v3/users/731f936bbf9440209371017bcf339ef8 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:02.098997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:02.231311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27276ca-0ba0-490c-9aef-a6edc12b1841 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:02.260951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:02.271435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:02.272086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.272377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.272662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.347117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:02.348625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360e665-2043-4605-945a-1f1e156cfbf2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:02.454060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 131/267] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:02.459326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:02.503211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181f31-2446-4874-bc27-91ec5a7fff6d None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.503527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181f31-2446-4874-bc27-91ec5a7fff6d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.503781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181f31-2446-4874-bc27-91ec5a7fff6d None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.505148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 132/268] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:02.512030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.512251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.512531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.538669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:02.540660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:02.588674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:02.639882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b994e-404b-4f77-82c8-649070f4640f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:02.654168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:02.683851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 133/269] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:02.698097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:02.698752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.699047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.699324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.700495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:02.701977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:02.703844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 137/270] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:02 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:02.709641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:02.726241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:02.848312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df21af3-ec54-4828-a54e-2a5950671add None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:02.866872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8912923-8be9-49fe-b703-d44698979a57 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:02.885333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:02.885989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.886278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.886556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.887353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=731f936bbf9440209371017bcf339ef8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:02.887668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:02.889131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c91b-e592-40c7-bc83-b12e634569e2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:02.901842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 134/271] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:02 2022] GET /identity/v3/role_assignments?user.id=731f936bbf9440209371017bcf339ef8&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=3b97713662114efa802df415a01374b4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:02.901842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae55ae-6869-4c79-9861-8fa1c5d1c9fc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.901842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae55ae-6869-4c79-9861-8fa1c5d1c9fc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.901842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae55ae-6869-4c79-9861-8fa1c5d1c9fc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.903050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 135/272] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:02.904424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7fc6-e8bf-473d-a2c9-43ebb252183b None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.904721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7fc6-e8bf-473d-a2c9-43ebb252183b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.905002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7fc6-e8bf-473d-a2c9-43ebb252183b None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.906394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 136/273] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:02.907552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.907854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.908130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.914283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:02.914953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.915232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.915500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.928282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:02.929129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:02.931515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-75e22873-f479-4c95-a8e4-c88555962936 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:02.934774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:02.935725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:02.936520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:02.937247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 138/274] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:02.938496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:02.938775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:02.939048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:02.951061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:02.970080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:02.971991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:03.004818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.020899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 137/275] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:03.022048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.093969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 139/276] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:03.095012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.141791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf9e1-474a-4624-a6ff-281b6f873073 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.186807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.187440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.187720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.187995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.188719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:03.189023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.190846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.203111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 138/277] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.204412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.223247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c76704-810e-4958-bc44-52c98c7a6860 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.225155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.263031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.264015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.264468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.264981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.277145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:03.282178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:03.283107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:03.284496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 140/278] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:03.285188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.311854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.325050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f104a-9820-4175-8ea6-450bf02c4634 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.362084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.363798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.364233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.364687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.366272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.368926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.371833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 139/279] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.373250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.395342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72745d-5c33-4bd7-8082-98da31038ceb None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.428829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.429466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.430302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.430765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] PATH_INFO: `/v3/users/4a0ae71f6b3946c2829153fe101db6cb` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.431934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] RBAC: Authorizing `identity:get_user(user_id=4a0ae71f6b3946c2829153fe101db6cb)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.433388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.435012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 141/280] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/users/4a0ae71f6b3946c2829153fe101db6cb => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.435743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.459605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.478408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0854-054f-4ed0-924e-6249aaa13dff None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.511501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.512111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.512399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.512675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.513379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:03.513689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.515083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5228-9247-4413-928b-51647788e7f4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.523100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 140/281] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.524373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcdf6e-3875-472d-b0ab-05fdbd1d9fd3 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.524664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcdf6e-3875-472d-b0ab-05fdbd1d9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.524946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcdf6e-3875-472d-b0ab-05fdbd1d9fd3 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.526378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 141/282] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:03.526910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.530949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcdf6e-3875-472d-b0ab-05fdbd1d9fd3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.536401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200088be-8659-470d-ac98-450ea9baa184 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.570079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.571233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.571515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.571792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.572474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.573923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.595509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 142/283] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:03 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:03.596325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.650534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcdf6e-3875-472d-b0ab-05fdbd1d9fd3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.689309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.690169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.690280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.690537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.691732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.693198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb9d4-39b4-4310-96ab-c9264db95f9f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.700675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 142/284] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.700675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.700675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.700675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.717204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:03.718480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:03.721955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.724250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd752-3299-46ac-8bb8-a197f34267b5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.767567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.769658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.769658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.769658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] PATH_INFO: `/v3/users/07163076abba462383b125a46a67be9f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.786088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] RBAC: Authorizing `identity:get_user(user_id=07163076abba462383b125a46a67be9f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.787933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.790103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 143/285] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/users/07163076abba462383b125a46a67be9f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.790534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.797934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 143/286] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:03.799719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.807562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.913390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b95b0-ffb6-4743-9b95-4d571c587d34 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.921770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a51cb-5819-43f1-9628-1796c70df657 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:03.957575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.958251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.958575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.958804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.959600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, user.id=07163076abba462383b125a46a67be9f, scope.system=all) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:03.959910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.961716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:03.962434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:03.962761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:03.962934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.963081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/users/4a0ae71f6b3946c2829153fe101db6cb/roles/11ba93a8f8af493ab35d6dd60c8adc0f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:03.965119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, user_id=4a0ae71f6b3946c2829153fe101db6cb, role_id=11ba93a8f8af493ab35d6dd60c8adc0f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:03.966726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:03.968709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 144/287] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/role_assignments?user.id=07163076abba462383b125a46a67be9f&scope.system=all&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:03.969432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:03.973464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:03.983737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 144/288] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:03 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/users/4a0ae71f6b3946c2829153fe101db6cb/roles/11ba93a8f8af493ab35d6dd60c8adc0f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:04.111075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafad7d-f95d-4cd2-8b3c-49f939c08629 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:04.157262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:04.158238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:04.158661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:04.159077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:04.172205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:04.177431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:04.178347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:04.179198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:04.181733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 145/289] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:04.188401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:04.261289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:04.299119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caabce-977a-45eb-a32e-23745203d4a1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:04.342100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:04.343050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:04.343597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:04.344039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:04.344921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:04.345418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:04.346977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:04.361510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 145/290] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:04.368564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:04.446444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:04.496653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88dc2-1622-4f94-abf2-d2913367d526 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:04.544847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:04.545550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:04.545852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:04.546180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] PATH_INFO: `/v3/users/f5766dc426a84857bed3dd1b2200c536` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:04.547351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] RBAC: Authorizing `identity:get_user(user_id=f5766dc426a84857bed3dd1b2200c536)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:04.548790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:04.550465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 146/291] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:04 2022] GET /identity/v3/users/f5766dc426a84857bed3dd1b2200c536 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:04.556626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:04.676028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad1d6-baa7-4c4e-9c29-e724e2ab4205 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:04.703910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:04.713187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:04.713831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:04.714111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:04.714385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:04.802175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:04.803646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:04.928860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 146/292] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:04.935063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:05.066917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db708-0f9a-41bd-9ea5-5c54ccb1e82c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:05.100801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:05.108320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:05.109089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:05.109480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:05.110004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:05.111722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:05.113177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05c09b-2948-42b2-8f8a-c0ae071ed734 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:05.115433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 147/293] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:04 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:05.121363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:05.166855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:05.297636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b20f-d833-420f-9a7f-be857a3463bb None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:05.339426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:05.340039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:05.340314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:05.340587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:05.341369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=f5766dc426a84857bed3dd1b2200c536) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:05.341675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:05.343120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770a133-e637-4940-9597-7d8ba03c6e89 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:05.354947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 147/294] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:05 2022] GET /identity/v3/role_assignments?user.id=f5766dc426a84857bed3dd1b2200c536&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:06.135191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd66f-5dea-49b7-bf95-493c45e0abb9 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.135731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd66f-5dea-49b7-bf95-493c45e0abb9 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.135731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd66f-5dea-49b7-bf95-493c45e0abb9 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.137405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 148/295] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:06.143006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422078e-b067-43ea-973a-ab40fe5e0e99 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.143438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422078e-b067-43ea-973a-ab40fe5e0e99 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.143635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422078e-b067-43ea-973a-ab40fe5e0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.161662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f422078e-b067-43ea-973a-ab40fe5e0e99 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:06.162886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f422078e-b067-43ea-973a-ab40fe5e0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:06.237917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 148/296] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:06.254149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd66f-5dea-49b7-bf95-493c45e0abb9 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.361227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd66f-5dea-49b7-bf95-493c45e0abb9 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:06.367925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53847-63ee-4991-b258-9df96d596766 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.368209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53847-63ee-4991-b258-9df96d596766 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.368485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53847-63ee-4991-b258-9df96d596766 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.370101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 149/297] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:06.374966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3374-60ab-4e15-b261-c13f3ef85c00 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.375253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3374-60ab-4e15-b261-c13f3ef85c00 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.375528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3374-60ab-4e15-b261-c13f3ef85c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.393924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7cdf3374-60ab-4e15-b261-c13f3ef85c00 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:06.395105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7cdf3374-60ab-4e15-b261-c13f3ef85c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:06.399262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:06.399922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.400206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.400480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.401640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:06.403111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:06.409273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 149/298] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:06.410464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.426180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:06.469651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 150/299] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:06.470950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80b23-1edd-457d-994c-5e5883804c2b None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.471239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80b23-1edd-457d-994c-5e5883804c2b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.471516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd80b23-1edd-457d-994c-5e5883804c2b None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.472755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 151/300] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:06.473779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d40-115e-493a-a1b7-815c670cfa75 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.474088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d40-115e-493a-a1b7-815c670cfa75 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.474364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d40-115e-493a-a1b7-815c670cfa75 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.477848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 152/301] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:06.478092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7c29d-5964-4a14-80b7-dacd4be2b4e9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.478380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7c29d-5964-4a14-80b7-dacd4be2b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.478655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7c29d-5964-4a14-80b7-dacd4be2b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.489063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:06.497640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e5a7c29d-5964-4a14-80b7-dacd4be2b4e9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:06.498881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e5a7c29d-5964-4a14-80b7-dacd4be2b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:06.524249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7fabb-1e0e-40fc-8531-052b67c362b7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:06.559310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:06.559934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.560235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.560496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] PATH_INFO: `/v3/groups` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.561161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:06.562628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:06.565602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 153/302] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:06.566945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.567233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.567505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.579280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 150/303] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Jul 26 12:38:06 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:06.580086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.600531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:06.601984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:06.682001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 154/304] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:06.682629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.701775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:06.720652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f4faa-49ab-410e-b5e2-f134a3776940 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:06.751035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:06.764907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:06.766679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.766679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.766679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.779333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:06.785611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:06.786630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 151/305] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:06.787845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.822252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0a301-f880-4c28-bb36-a8b3a1785bfd None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:06.859176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:06.859822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.860107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.860378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.870920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:06.875998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:06.876887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:06.877685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 155/306] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:06.878905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.903326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa839-6583-4768-a73d-480f17acea7d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:06.939706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:06.940742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:06.941322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:06.941613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:06.952937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:06.954674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:06.960415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:06.961388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:06.962234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 152/307] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:06.962909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:06.990199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6600-de1f-4a99-85b7-4b4ac1ff920d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.014612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.027156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.027797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.028079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.028360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.029086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:07.029391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.030799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.044472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 156/308] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.044472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.083005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f711-7c2b-4d05-aa70-08c08be26f3f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.121232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.121924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.122215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.122497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.123501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:07.123816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.125340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.134561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 153/309] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.134561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.150955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce4283-60bd-4b31-9a44-1bcd3ac04761 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.186053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.186670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.186950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.187225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.187930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:07.188237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.189587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.190976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.198274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 157/310] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.198888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.260556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027d30c-07a8-4359-a506-eb67d2db35fc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.271437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.298904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.299547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.299824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.300097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] PATH_INFO: `/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.315093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] RBAC: Authorizing `identity:get_user(user_id=fbb1d6ced0d14a1a9e88b9410c9332a2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.316552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.316658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4347a-141e-4d20-b31f-c503a33a7a05 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.318440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 154/311] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.324171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.354802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.355467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.355753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.356037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] PATH_INFO: `/v3/users/4a0ae71f6b3946c2829153fe101db6cb` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.357220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] RBAC: Authorizing `identity:get_user(user_id=4a0ae71f6b3946c2829153fe101db6cb)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.358697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.360662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 158/312] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/users/4a0ae71f6b3946c2829153fe101db6cb => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.361502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.428012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.435006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af534f-c82a-4761-a96c-b641aa7bec3a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.466747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fa35d-fd2f-47fa-ab6b-9051c282aea1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.471963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.472608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.472887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.473265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] PATH_INFO: `/v3/users/07163076abba462383b125a46a67be9f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.474448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] RBAC: Authorizing `identity:get_user(user_id=07163076abba462383b125a46a67be9f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.476014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.478514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 155/313] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/users/07163076abba462383b125a46a67be9f => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.479098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.506928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.508074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.508546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.508819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.509566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, user.id=fbb1d6ced0d14a1a9e88b9410c9332a2, scope.system=all) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:07.509901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.511316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.525844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 159/314] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/role_assignments?user.id=fbb1d6ced0d14a1a9e88b9410c9332a2&scope.system=all&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:07.525844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.527423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.610888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85830e4-084c-40a0-a488-42b3fde6fd54 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.655509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.656278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.656891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.657248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.672695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687184c9-ceec-40d3-ba94-fbbbf7822b7a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:07.704681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.717957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:07.717957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:07.717957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:07.717957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] PATH_INFO: `/v3/system/users/07163076abba462383b125a46a67be9f/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:07.719144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=07163076abba462383b125a46a67be9f, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.720864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.733154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 160/315] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Jul 26 12:38:07 2022] PUT /identity/v3/system/users/07163076abba462383b125a46a67be9f/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:07.751873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:07.753638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:07.795139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:07.869354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 156/316] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:07.879124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:07.986117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b50689-aa08-4eb1-a29a-6b6006c37134 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:08.021491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:08.022170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:08.022455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:08.022733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:08.028947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:08.030600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1925a-f8e2-4d97-aa74-4574c1289b54 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:08.032755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 161/317] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:07 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:08.044851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:08.150415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39b70-c5cb-41a5-9fa7-ced7f8c0b754 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:08.186398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:08.187264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:08.187691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:08.188136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:08.189071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, scope.project.id=d809accf9a214c6185035b2a89a98317, user.id=4a0ae71f6b3946c2829153fe101db6cb) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:08.189529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:08.191151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a425b8-7969-442e-955f-8fa882ab2c11 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:08.194478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:08.200252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 157/318] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:08 2022] GET /identity/v3/role_assignments?user.id=4a0ae71f6b3946c2829153fe101db6cb&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:08.666292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9161-2b4b-4b57-82b1-0dc67362517c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:08.666825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9161-2b4b-4b57-82b1-0dc67362517c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:08.666825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f9161-2b4b-4b57-82b1-0dc67362517c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:08.668537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 162/319] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:08.673955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:08.674253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:08.674539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:08.692494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:08.693898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:08.778106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 158/320] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:08.800524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f9161-2b4b-4b57-82b1-0dc67362517c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:08.862006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:08.911299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f9161-2b4b-4b57-82b1-0dc67362517c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:08.946136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:08.946696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:08.946982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:08.947258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:08.948419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:08.949870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f331a-dd79-4822-b41c-65d3370920c7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:08.951642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 163/321] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:08.956991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:09.063009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37193a-a1d3-42e3-a1ae-73822b82cc54 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:09.090989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:09.097945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:09.098577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.098864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.099145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] PATH_INFO: `/v3/groups` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.099822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:09.101835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478e735-3ba9-4f1f-a7ef-d81a30da42a4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:09.117893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 159/322] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Jul 26 12:38:08 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:09.572080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266155-b88a-421d-981a-8651fb43243c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.572693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266155-b88a-421d-981a-8651fb43243c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.572979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266155-b88a-421d-981a-8651fb43243c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.574671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 164/323] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:09.579841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ec77-d0bc-418b-99a1-c0dcb7490721 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.580304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ec77-d0bc-418b-99a1-c0dcb7490721 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.580476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ec77-d0bc-418b-99a1-c0dcb7490721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.602081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6ed0ec77-d0bc-418b-99a1-c0dcb7490721 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:09.603415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6ed0ec77-d0bc-418b-99a1-c0dcb7490721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:09.684357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 160/324] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:09.707679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4266155-b88a-421d-981a-8651fb43243c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:09.834068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ab78-7b03-4808-82fb-eaac05d136c9 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.834708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ab78-7b03-4808-82fb-eaac05d136c9 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.835208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ab78-7b03-4808-82fb-eaac05d136c9 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.837066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 161/325] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:09.842548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4266155-b88a-421d-981a-8651fb43243c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:09.842692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.842986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.843291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.878634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:09.880467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:09.880854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:09.888743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:09.889407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:09.889689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:09.890001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:09.907983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:09.913657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:09.915581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:09.916974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 165/326] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:09.921486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.013590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 162/327] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:10.074981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.098817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17fc8-e7ca-43a0-add4-e5c3cf303067 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.162587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:10.171734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.172307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.172655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.172844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.173562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:10.173895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.175273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.192657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 166/328] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:10.203120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.231776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efcc51-5ff9-496e-b9d5-5946d8a0c2dd None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.271777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.272916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.273854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.274520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.284286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:10.291718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:10.298010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:10.298893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:10.299699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:10.302384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 163/329] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:10.308387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.376045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7ee6-3478-4891-ae6a-4d5036f5549d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.440462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ec14-02fd-41f1-a7e2-3fe088f7aa41 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.444644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.445851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.446142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.446415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] PATH_INFO: `/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.450525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] RBAC: Authorizing `identity:get_user(user_id=fbb1d6ced0d14a1a9e88b9410c9332a2)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.451993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.454598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 167/330] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:10 2022] GET /identity/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2 => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:10.456334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:10.459145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.496212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.496952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.497242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.497521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.498299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:10.498606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.500198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.514262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 164/331] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:10.531592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.627926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b1be4-4afa-492d-aba3-8905ab81a7cf None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.666915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:10.696357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd19b-2ecc-4278-9805-a31fe4ee0aa2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.722056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.723471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.723971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.724440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] PATH_INFO: `/v3/system/users/fbb1d6ced0d14a1a9e88b9410c9332a2/roles/11ba93a8f8af493ab35d6dd60c8adc0f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.726717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fbb1d6ced0d14a1a9e88b9410c9332a2, role_id=11ba93a8f8af493ab35d6dd60c8adc0f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.728759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.747127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 168/332] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Jul 26 12:38:10 2022] PUT /identity/v3/system/users/fbb1d6ced0d14a1a9e88b9410c9332a2/roles/11ba93a8f8af493ab35d6dd60c8adc0f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:38:10.748889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.749721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.750141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.750426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] PATH_INFO: `/v3/users/07163076abba462383b125a46a67be9f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.751805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] RBAC: Authorizing `identity:get_user(user_id=07163076abba462383b125a46a67be9f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.753425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1142-ebe2-412c-8141-a89bf3c0dd09 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.755579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 165/333] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:10 2022] GET /identity/v3/users/07163076abba462383b125a46a67be9f => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:10.761424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:10.889006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff842e5-d4b1-427e-b59c-2646e6c508e7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:10.933139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:10.934134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:10.934669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:10.935138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:10.936111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] RBAC: Adding query filter params (role.id=c8019a06791c4c888509f83d28e2ce55, user.id=07163076abba462383b125a46a67be9f, scope.system=all) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:10.936619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:10.938268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0290-f998-4c59-a69c-eee6e060d85e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:10.953636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 169/334] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Jul 26 12:38:10 2022] GET /identity/v3/role_assignments?user.id=07163076abba462383b125a46a67be9f&scope.system=all&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:11.895535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71523-bf9c-403b-a73b-36cee0f0ac89 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:11.896042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71523-bf9c-403b-a73b-36cee0f0ac89 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:11.896117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71523-bf9c-403b-a73b-36cee0f0ac89 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:11.897700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 166/335] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:11.903859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823076-309e-47b4-86af-25df467443f1 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:11.904707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823076-309e-47b4-86af-25df467443f1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:11.905186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823076-309e-47b4-86af-25df467443f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:11.934831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-00823076-309e-47b4-86af-25df467443f1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:11.936371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-00823076-309e-47b4-86af-25df467443f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:11.985751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:12.052150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 170/336] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:12.084388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b3d63-7bbe-4995-ba81-533f33b4a3c3 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.085002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b3d63-7bbe-4995-ba81-533f33b4a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.085703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b3d63-7bbe-4995-ba81-533f33b4a3c3 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.087637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 167/337] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:12.092777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b3d63-7bbe-4995-ba81-533f33b4a3c3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.093215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.093513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.093798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.127544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:12.129056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:12.206650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:12.230987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 171/338] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:12.267648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.358999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b3d63-7bbe-4995-ba81-533f33b4a3c3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:12.434519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:12.435538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.436024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.436497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.464382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:12.469126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f5030-a3ae-4711-82ec-e8b12731616f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:12.471143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:12.476856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:12.477995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:12.478881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:12.486246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 168/339] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:12.497829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.524727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:12.526166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.526658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.527157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.548213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:12.554234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:12.555733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:12.556539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:12.563669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 172/340] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:12.570677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.707657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:12.712116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ae45b-2ab5-4a62-a17c-40aecedc8057 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:12.715830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6ec9-7792-4a02-b9d5-38a54dfa07bf None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:12.773843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:12.774485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.774762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.775036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.775759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:12.776063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:12.777427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b6295-43fc-4f2b-929a-e42045f03a85 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:12.782881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:12.783598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.783888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.784233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.785010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:12.785392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:12.786931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:12.799988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 173/341] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:12.801069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5b2de-3f34-4299-a7a7-d7f60ac3c277 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:12.801388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5b2de-3f34-4299-a7a7-d7f60ac3c277 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:12.803487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 169/342] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:12.803694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5b2de-3f34-4299-a7a7-d7f60ac3c277 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:12.806768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.807154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 174/343] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:12.812990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5b2de-3f34-4299-a7a7-d7f60ac3c277 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:12.851503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:12.986946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10e8ca-f82a-4104-bffd-6bbcf07087fa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:12.997678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5b2de-3f34-4299-a7a7-d7f60ac3c277 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:13.065386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.066568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.068040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.068708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.083371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.084010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.084293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.084570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.132047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.204922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:13.206428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46609780-c962-4415-9aa2-fd76dd6794fa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:13.229952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:13.231424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:13.278114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.401842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 170/344] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 12:38:13.401842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.402093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.402332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.429041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 175/345] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:13.430645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:13.441799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:13.443025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:13.556416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.580891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 171/346] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:13.581581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:13.619914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047ac4-0de9-4402-b0fd-15a75ba00948 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:13.649921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.663103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.664401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.664738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.665012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.666253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:13.667683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80ef2a-3e8c-4def-bc65-746e0f93a3e0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:13.669652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 176/347] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:13.670839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109323-b38f-481f-a414-ef9b3f8e468c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.671119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109323-b38f-481f-a414-ef9b3f8e468c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.671390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109323-b38f-481f-a414-ef9b3f8e468c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.674639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 177/348] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:13.675596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109323-b38f-481f-a414-ef9b3f8e468c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:13.713032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad943fa-45b0-4683-8423-b38214b0a324 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:13.752128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.752788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.753124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.753446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.754645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:13.756352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:13.758785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 172/349] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:13.759508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:13.800603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109323-b38f-481f-a414-ef9b3f8e468c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:13.825999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.851307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.851307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.851307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.851307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.865925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:13.870902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597d7a-0484-4de5-a6e9-bd6c59a7e3ca None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e4e3483b-8e78-4a9d-b376-eb52aef64fb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:13.872874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:13.873913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:13.874761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 178/350] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:13.876530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8505-3ae8-48a9-ad99-50d3f4adb284 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.876530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8505-3ae8-48a9-ad99-50d3f4adb284 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.876530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8505-3ae8-48a9-ad99-50d3f4adb284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.898836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e8bc8505-3ae8-48a9-ad99-50d3f4adb284 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:13.900480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e8bc8505-3ae8-48a9-ad99-50d3f4adb284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:13.919407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:13.920068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.920355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.920639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.928994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:13.931501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:13.934113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 173/351] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:13.935194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:13.957290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:13.988093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 179/352] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:13.990002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e5f0-b6ca-4e26-bdf0-8845fce2ed10 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:13.990561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e5f0-b6ca-4e26-bdf0-8845fce2ed10 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:13.990843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e5f0-b6ca-4e26-bdf0-8845fce2ed10 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:13.992689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 180/353] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:13.995490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e5f0-b6ca-4e26-bdf0-8845fce2ed10 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.068087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00133-9c46-4f67-8f04-637f7608e2d8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.097275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:14.115792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.117315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.119751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.120224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.121643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:14.123777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:14.125944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 174/354] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:14.126728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.143439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e5f0-b6ca-4e26-bdf0-8845fce2ed10 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.198255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.199535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.200069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.200781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.202220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:14.202741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:14.205061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66dd84-e5cd-4019-a3f4-e2ae06b73298 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:14.218265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 181/355] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:14.224138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd61dc-f766-445a-9760-8a336564ecde None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.224427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd61dc-f766-445a-9760-8a336564ecde None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.224700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd61dc-f766-445a-9760-8a336564ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.245546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-72fd61dc-f766-445a-9760-8a336564ecde None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:14.246767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-72fd61dc-f766-445a-9760-8a336564ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:14.282353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89d53-55d9-4b9b-956a-2845318a179f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.294684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:14.334169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.334803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.335083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.335358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.337237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=214bbbb187114431a614cb0adfb5275f) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:14.337559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:14.339086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:14.343137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 182/356] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:14.345609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24829-87a2-4e03-9ac4-47cccb4d0c05 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.346038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24829-87a2-4e03-9ac4-47cccb4d0c05 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.346323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24829-87a2-4e03-9ac4-47cccb4d0c05 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.347974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 183/357] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:14.348772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24829-87a2-4e03-9ac4-47cccb4d0c05 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.361060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 175/358] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:14.361060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.494328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:14.534307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24829-87a2-4e03-9ac4-47cccb4d0c05 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.560677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ba43-2537-4cbb-90bf-407dd47c3c34 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.579958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.580607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.580892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.581168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.601966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:14.607457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.608089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.608372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.608649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.609448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=3b97713662114efa802df415a01374b4, scope.project.id=214bbbb187114431a614cb0adfb5275f) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:14.609761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:14.610454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:14.611350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:14.612143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:14.612760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0498f9-a46a-4c12-bc2f-1cb1f4fbb579 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:14.614884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 184/359] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:14.618061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.624366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 176/360] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=3b97713662114efa802df415a01374b4 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:14.624366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface055-2573-4072-9165-87105442326a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.624366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface055-2573-4072-9165-87105442326a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.624366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface055-2573-4072-9165-87105442326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.653408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fface055-2573-4072-9165-87105442326a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:14.655101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fface055-2573-4072-9165-87105442326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:14.666014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:14.777429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 177/361] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:14.779149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface055-2573-4072-9165-87105442326a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:14.798607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b1885-2484-46f1-a7e8-2ab419b4a821 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.840294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:14.858769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.859477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.859591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.859855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.912980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface055-2573-4072-9165-87105442326a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:14.958202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:14.960112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:14.965047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:14.965706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:14.966057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:14.966330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:14.980912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:14.987166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:14.988126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:14.988950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 178/362] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:14.989611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.005187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.105665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 185/363] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:15.106885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.131631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e6c6f-3336-4712-8344-b0e84d8131f1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.153030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.189936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.191477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.191976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.192743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.193987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:15.194967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.196898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.209060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 179/364] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:15.214377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.254058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0146-93d9-4507-b930-60b0fbc7beb6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.289473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.299904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.301496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.302021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.302768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.317621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:15.324808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:15.325770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 12:38:15.326663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:15.329382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 186/365] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:15.329382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.358308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955ce4-fcdc-4827-aa8d-fe50699aaba8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.405321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.406566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.407411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.408151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.409115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:15.409632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.412250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.424933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 180/366] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:15.426413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.455222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a356f-7c28-43c3-94ca-f8c3ceec10d1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.474351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.500325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.501518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.502448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.502943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.504688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.506430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.508715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 187/367] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:15.514363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.564724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d910e-50fc-414a-ad7d-142b1f46fd64 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.594324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.602646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.603457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.603843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.604276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.651879 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e716581-29b7-42d4-b717-edaa4a6d07aa None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.690225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.691758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.696572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.697380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.697835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.698281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.699149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:15.699594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.701087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.712914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 188/368] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:15.714165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.733491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.810469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 181/369] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:15.811330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.843156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0356-ebe4-406c-be0c-79b3625b2f6b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.867206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.880351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.881274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.881748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.882263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.921604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7fdd-d9cf-48c0-88a4-ed1f9feac052 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:15.965569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:15.966266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:15.966609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:15.966964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:15.968211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.971217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:15.973088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 182/370] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:15.973872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:15.979223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:15.983395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:15.985065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.112791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce031-c804-41b6-87a2-d67a30c30360 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.114762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 189/371] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:16.116971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.155049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.155891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.156416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.156794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] PATH_INFO: `/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.158735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] RBAC: Authorizing `identity:get_user(user_id=fbb1d6ced0d14a1a9e88b9410c9332a2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.160745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.163135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 183/372] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:38:15 2022] GET /identity/v3/users/fbb1d6ced0d14a1a9e88b9410c9332a2 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.164408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.174206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.255269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.265345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1d61-3096-4619-8330-99236c4a3211 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.307769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ee1c2-c395-49b0-9e02-b68aa0526823 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.311562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.312460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.312958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.313427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.314887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.317005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.319337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 190/373] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.320673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.358615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.359482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.359771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.360049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.361246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=d809accf9a214c6185035b2a89a98317) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:16.361563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.363603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.374414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 184/374] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.375333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.469989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.492714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d09c3-e0df-4e3c-80ff-1933b55b0ff9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.564120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.564741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.565023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.565299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] PATH_INFO: `/v3/projects/269bfb061a4341bbbc905a39cb4bf398` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.566552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] RBAC: Authorizing `identity:get_project(project_id=269bfb061a4341bbbc905a39cb4bf398)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.567998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.569703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 191/375] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/projects/269bfb061a4341bbbc905a39cb4bf398 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.570655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652426b0-eb39-4bb4-8deb-2e92ac22f9bd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.575037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.618844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.619555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.619842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.620120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.620922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] RBAC: Adding query filter params (role.id=11ba93a8f8af493ab35d6dd60c8adc0f, user.id=fbb1d6ced0d14a1a9e88b9410c9332a2, scope.system=all) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:16.621304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.623441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.625864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.641738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 185/376] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/role_assignments?user.id=fbb1d6ced0d14a1a9e88b9410c9332a2&scope.system=all&role.id=11ba93a8f8af493ab35d6dd60c8adc0f => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.643308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.731745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80812794-d1fd-4c39-a8f4-56163f3583f4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.782574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.782808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.783031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.783209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.784586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.786182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66bf00-1954-4f54-8a7f-ec3d1e5c83ab None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.788189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 192/377] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.790355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db8aa-515f-44bf-91e8-eaa09410a1c1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.790637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db8aa-515f-44bf-91e8-eaa09410a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.790908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db8aa-515f-44bf-91e8-eaa09410a1c1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.796424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 193/378] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:16.798604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db8aa-515f-44bf-91e8-eaa09410a1c1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:16.810908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d55f-466f-4570-9c7c-7551fe9e6772 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.838990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.858590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:16.860408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.860917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.861472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] PATH_INFO: `/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.870414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] RBAC: Authorizing `identity:get_group(group_id=0a48d7da9d7549f793a6a1aaa74daa6e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:16.873042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99acfa-7b67-4868-b122-3ae5cb1db716 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:16.875534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 186/379] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:16.877054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:16.877555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:16.879198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:16.905506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:16.907211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:16.955060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db8aa-515f-44bf-91e8-eaa09410a1c1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:16.971154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:16.992054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 187/380] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:16.992983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.003192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.004127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.004966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.005445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.006799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=3b97713662114efa802df415a01374b4, scope.project.id=d809accf9a214c6185035b2a89a98317) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:17.007580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:17.009387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:17.016943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 194/381] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=3b97713662114efa802df415a01374b4 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:17.047130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.151033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435121-8d0d-4849-9c06-6c2155558e6e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.175470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:17.189388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5ecf-adf9-4ac7-aacb-af30ec7547ce None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.197053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.197716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.198005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.198287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.199096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] RBAC: Adding query filter params (group.id=0a48d7da9d7549f793a6a1aaa74daa6e, role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=269bfb061a4341bbbc905a39cb4bf398) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:17.199407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:17.200841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5be32-7028-4a4b-99af-614ddd0abef2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:17.211391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 188/382] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:16 2022] GET /identity/v3/role_assignments?group.id=0a48d7da9d7549f793a6a1aaa74daa6e&scope.project.id=269bfb061a4341bbbc905a39cb4bf398&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:17.211391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ea91-e5ed-431b-afb7-a604da2a7f30 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.211391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ea91-e5ed-431b-afb7-a604da2a7f30 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.211391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ea91-e5ed-431b-afb7-a604da2a7f30 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.211952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 189/383] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:17.217383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.217768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.218146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.241263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:17.243157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:17.253127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.254136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.254638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.255092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.279027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:17.285406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:17.286336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:17.287140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:17.296309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 195/384] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:17.296985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:17.301902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.322030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 190/385] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:17.349207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.477590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34146d4-3a67-4723-a9f1-73f2749a2ec7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.526583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.526938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.527230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.527507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.535258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58011da-2d09-41d0-9d0b-a9e6e6e6a9b6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.561135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:17.566218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:17.567100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:17.568324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 191/386] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:17.573337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.596413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.597155 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.597440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.597718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.598473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:17.598777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:17.600149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:17.610939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 196/387] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:17.616447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.637615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:17.662211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:17.737619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747be27-80f5-4886-bd0e-8a124086d112 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.774919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f79d-ead4-48d3-a282-a5ec977aa78a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:17.775283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.775941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.776219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.776604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.777793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:17.779363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:17.781271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 197/388] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:17.789285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.858436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:17.859074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:17.859357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:17.859633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:17.860425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:17.860734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:17.866411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:17.881286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 192/389] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:17.887165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:17.950214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:17.986180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642730c-28c8-4fab-b505-70df1e22d73c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:18.061105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b83-7ea3-42fd-ba7d-f2de94db6bb8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:18.062910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:18.066741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:18.067401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.067680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.067961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.074603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:18.076058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:18.078106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 198/390] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:18.083198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:18.104259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:18.105277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.105759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.106266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.108283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:18.110339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:18.112485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 193/391] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:17 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:18.121135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:18.208747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3330-2441-4e4d-81c4-dad034372ff8 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:18.246387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:18.247064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.247353 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.247631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/groups/3b911a70b29144e3884005e43b2a282e/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.253039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, group_id=3b911a70b29144e3884005e43b2a282e, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:18.253039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:18.270906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 199/392] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Jul 26 12:38:18 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/groups/3b911a70b29144e3884005e43b2a282e/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:38:18.302519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1cfa-30f5-4389-9c23-64c663409f2d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:18.356701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:18.357377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.357660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.357963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.359221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:18.360770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732905-78ab-4d67-a1a7-bbd252fcfb7a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:18.363636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 194/393] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:18 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:18.369598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:18.392332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:18.546483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21645-d9bb-4784-ac66-9657f7e597a9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:18.586766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:18.587450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.587736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.588022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f/groups/3b911a70b29144e3884005e43b2a282e/roles/3b97713662114efa802df415a01374b4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.590282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] RBAC: Authorizing `identity:create_grant(project_id=214bbbb187114431a614cb0adfb5275f, group_id=3b911a70b29144e3884005e43b2a282e, role_id=3b97713662114efa802df415a01374b4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:18.591722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debff8-a397-4a8b-8fd5-03360f0cdd65 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:18.606138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 200/394] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Jul 26 12:38:18 2022] PUT /identity/v3/projects/214bbbb187114431a614cb0adfb5275f/groups/3b911a70b29144e3884005e43b2a282e/roles/3b97713662114efa802df415a01374b4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:18.863014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005207e2-9d7a-4fef-9cbb-ad45600b7612 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.863347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005207e2-9d7a-4fef-9cbb-ad45600b7612 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.863539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005207e2-9d7a-4fef-9cbb-ad45600b7612 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.865377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 195/395] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:18.871772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:18.872065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:18.872351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:18.891801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:18.893008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:18.969054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:18.975133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 201/396] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:19.027625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005207e2-9d7a-4fef-9cbb-ad45600b7612 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.079751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:19.167573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005207e2-9d7a-4fef-9cbb-ad45600b7612 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.214822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.215753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.216185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.216606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.231949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:19.238360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:19.239459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:19.240736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:19.243646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 196/397] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:19.249114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.355764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c125a44-e5dd-4660-b539-b43e6c062c51 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.392913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.394264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.394711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.395134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.395995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] RBAC: Adding query filter params (name=member) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:19.396453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:19.398545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312028e1-c950-4260-a84f-194c0e4b3deb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:19.408119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 202/398] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:19.415169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.469802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd3a5-b70e-40d8-96b6-a4738e306c29 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.470126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd3a5-b70e-40d8-96b6-a4738e306c29 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.470348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd3a5-b70e-40d8-96b6-a4738e306c29 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.472037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 203/399] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:19.478376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.478663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.478945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.498440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:19.499732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:19.546237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:19.551149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb5a0-81e7-4c55-9bb7-3eebd206a905 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.580330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:19.600323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 204/400] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:19.614511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.615420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.615707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.615985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.617312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:19.618767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:19.621561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 197/401] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:19.624341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.625984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.734859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188d92-22cc-4294-8135-5a108134ff27 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.775915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.776929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.777430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.777947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.799903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb98da-1950-4602-a5a4-2bc3bdd7bf11 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.805891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:19.814960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:19.815848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:19.816660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 205/402] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:19.823861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.858454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.859760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.860065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.860351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.861541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:19.864212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b2a2-2cd8-49c9-afd8-5869d7fce8e3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:19.866472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 198/403] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:19.868273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4b4f-9ca1-461c-a318-00cd27043284 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.868584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4b4f-9ca1-461c-a318-00cd27043284 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.869394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4b4f-9ca1-461c-a318-00cd27043284 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.870914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 199/404] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:19.872521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4b4f-9ca1-461c-a318-00cd27043284 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:19.889187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:19.926493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:19.954499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f1f7-125c-4a51-9c5b-b48ac3a04987 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:19.994063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:19.994907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:19.995327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:19.995835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:19.997060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:19.997502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:19.999128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f062251-8bfd-4017-90be-2b3d386d7d5e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.003349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4b4f-9ca1-461c-a318-00cd27043284 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.008747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 206/405] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:20.010301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.010913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.011389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.030883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:20.032444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:20.052446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.053235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.053580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.053897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/groups/3b911a70b29144e3884005e43b2a282e/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.056088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, group_id=3b911a70b29144e3884005e43b2a282e, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.057693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.081843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 200/406] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Jul 26 12:38:19 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/groups/3b911a70b29144e3884005e43b2a282e/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:38:20.081843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.159258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 207/407] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:20.182060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.247600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:20.261431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b57ca-41f2-4b61-8067-746eb7676814 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.282415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:20.309700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.310653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.311343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.311632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.313104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.314613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.317461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 201/408] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:20.323005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.354066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1afe-158b-433e-8bc1-26274e4da481 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.392605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.393334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.393868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.393943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.405497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:20.411128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:20.412075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:20.413229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 208/409] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:20.428201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.437618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca281-e9e3-4b57-9b07-bf10e64a3648 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.474128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.474872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.475163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.475499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.482610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.484081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.487171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 202/410] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:20.510730 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.562713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:20.641205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fb4b-5bd9-4e52-a690-d4ae7d1d010f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.678625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.679857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.680143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.680431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317/groups/3b911a70b29144e3884005e43b2a282e/roles/3b97713662114efa802df415a01374b4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.682752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] RBAC: Authorizing `identity:create_grant(project_id=d809accf9a214c6185035b2a89a98317, group_id=3b911a70b29144e3884005e43b2a282e, role_id=3b97713662114efa802df415a01374b4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.684520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.692558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf8706-eac9-404d-b599-e56a62d62268 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.694448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:20.706824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 203/411] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Jul 26 12:38:20 2022] PUT /identity/v3/projects/d809accf9a214c6185035b2a89a98317/groups/3b911a70b29144e3884005e43b2a282e/roles/3b97713662114efa802df415a01374b4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:38:20.754809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.755451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.755795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.756079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.756814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:20.757123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.758976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.774574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 209/412] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:20.780221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:20.901590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:20.916599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88580042-86c3-4577-aeea-0334a75aea89 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:20.958398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:20.959060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:20.959346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:20.959625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] PATH_INFO: `/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:20.960878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] RBAC: Authorizing `identity:get_group(group_id=0a48d7da9d7549f793a6a1aaa74daa6e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:20.962370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fef90f-1426-4ab1-b11b-54f091339229 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:20.964283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 204/413] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:20.969771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.062652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28ae0-56ed-4496-b376-b3eda98d1db6 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.062936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28ae0-56ed-4496-b376-b3eda98d1db6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.063219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28ae0-56ed-4496-b376-b3eda98d1db6 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.064584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 205/414] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:21.070363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c956d-b6c5-44ef-b135-dc26a56c06f3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.070918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c956d-b6c5-44ef-b135-dc26a56c06f3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.071402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c956d-b6c5-44ef-b135-dc26a56c06f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.085096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b00a6-4d08-4959-88fc-f1067fa46c75 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.094567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-de7c956d-b6c5-44ef-b135-dc26a56c06f3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:21.096011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-de7c956d-b6c5-44ef-b135-dc26a56c06f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:21.161485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.162676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.165543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.166073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] PATH_INFO: `/v3/projects/269bfb061a4341bbbc905a39cb4bf398` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.168370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=269bfb061a4341bbbc905a39cb4bf398)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:21.170318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:21.173422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 210/415] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:20 2022] GET /identity/v3/projects/269bfb061a4341bbbc905a39cb4bf398 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:21.178990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.199633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 206/416] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:21.233173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:21.239585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539bf4-ebca-479b-93e9-e5d004471bcc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.240390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539bf4-ebca-479b-93e9-e5d004471bcc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.240881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539bf4-ebca-479b-93e9-e5d004471bcc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.242713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 207/417] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:21.247559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.248057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.248525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.273949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:21.275662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:21.323729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520ac-e5f0-4461-8a2b-2c0254e2a3d1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.362674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.363860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.364335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.364801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] PATH_INFO: `/v3/projects/269bfb061a4341bbbc905a39cb4bf398/groups/0a48d7da9d7549f793a6a1aaa74daa6e/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.367919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=269bfb061a4341bbbc905a39cb4bf398, group_id=0a48d7da9d7549f793a6a1aaa74daa6e, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:21.369576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:21.369862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 208/418] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:21.370940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.393600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:21.406863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 211/419] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Jul 26 12:38:21 2022] PUT /identity/v3/projects/269bfb061a4341bbbc905a39cb4bf398/groups/0a48d7da9d7549f793a6a1aaa74daa6e/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:21.412284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.498894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403bd3e-c82d-4093-bcd7-6050388d7524 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.547561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.548301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.548588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.548918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.571314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:21.576465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:21.577361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:21.578208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:21.581841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 209/420] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:21.588962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.611707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:21.623930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140888e-271d-4acb-ba8e-1c8df976d7f9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.663317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.664629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.665119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.665598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.676644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:21.683224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:21.684134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:21.684961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:21.686065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:21.688059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 212/421] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:21.694837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.716587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db213d-2c68-4690-89b7-89306fe992d4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.785439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.787500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.787782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.788059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.789081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:21.789482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:21.790902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:21.810117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 210/422] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:21.818814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.867788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd579bc-288e-4a25-8675-f89f084630d9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:21.913237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:21.915057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:21.915558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:21.916033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:21.917056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:21.917684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:21.919369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:21.929146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 213/423] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:21.936403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:21.959631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:21.975690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b94f1-6f51-4614-a4b1-5093cf9c8e07 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.051091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.051826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.052025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.052311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.061119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab5dc-65b6-47dd-a5f9-256a2a3a4cda None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.068160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.103414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.104431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.104911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.105381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.183624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.185421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd4aa3-75c1-4db3-8c26-74baadfcafbc None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.255008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.260321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.293916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.393901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 211/424] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:22.393901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f05bc-1865-4476-8e0a-fa67ff542929 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.393901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f05bc-1865-4476-8e0a-fa67ff542929 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.393901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f05bc-1865-4476-8e0a-fa67ff542929 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.397029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 212/425] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:22.399193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.399482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.399762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.402926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 214/426] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:22.404205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.418733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:22.419873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:22.463118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.503927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 213/427] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:22.504948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.521910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f9b4f-a192-4cd7-83cb-17e7875ed1d0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.539300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.564641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.565576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.566080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.566646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.568103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.570280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.573302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 215/428] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:22.578637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.606089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b14d9-bbe5-43de-8be0-191cebf5e872 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.641690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.642382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.642664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.642940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] PATH_INFO: `/v3/projects/214bbbb187114431a614cb0adfb5275f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.644245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] RBAC: Authorizing `identity:get_project(project_id=214bbbb187114431a614cb0adfb5275f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.645629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.652295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 214/429] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/projects/214bbbb187114431a614cb0adfb5275f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:22.652916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.693347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.696021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7385-dc7c-4994-86da-e839cc1aa771 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.737417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.738414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.738889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.739402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.752226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:22.759038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:22.760013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 12:38:22.760810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:22.761411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5198eb-04c3-4cdf-b756-b8f40ac16d5a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.763581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 216/430] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:22.764660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.795940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.796605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.796887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.797163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.798463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.799959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.801731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 215/431] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:22.802571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.822736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.892956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c90f7-a077-41e3-b7f3-c1c178064b84 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.908344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae30-d2b8-4f22-93eb-27f2b6cadeb2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:22.915824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:22.935196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.936331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.936807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.937273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.938767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.940496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.943039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 217/432] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:22.944702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:22.949431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:22.950095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:22.950394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:22.951366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:22.951366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] RBAC: Adding query filter params (name=member) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:22.951670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:22.953037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:22.962346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 216/433] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:22.963247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.068111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351662-5dca-42ae-a0b1-880c96b6874c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.075866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4aa5d-dace-4ba1-a728-5186a1ac29de None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.082090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.112587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.113206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.113632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.113951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.114762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=214bbbb187114431a614cb0adfb5275f) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:23.115629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:23.118161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:23.124846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.125339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 218/434] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:23.126011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.126227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.126800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.127283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.128314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=3b97713662114efa802df415a01374b4, scope.project.id=214bbbb187114431a614cb0adfb5275f) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:23.129135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:23.131921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ea472-5dc4-4349-9c27-70c8ad243c60 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:23.141193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 217/435] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:22 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=214bbbb187114431a614cb0adfb5275f&role.id=3b97713662114efa802df415a01374b4 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:23.204339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e647a-b8a8-4d78-b8f5-95d392d9685c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.205013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e647a-b8a8-4d78-b8f5-95d392d9685c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.205517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e647a-b8a8-4d78-b8f5-95d392d9685c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.207518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 218/436] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:23.218311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.219244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.219739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.256437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:23.258278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:23.294597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.337356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4c9f6-daef-45f6-bd6c-7e52ebb1dd5a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.354445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 219/437] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:23.381314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.384700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.386584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.386584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.386823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.454188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.486656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:23.488108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:23.516648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606cdc2-e5a9-4aae-a945-7c5d7bf08ff4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.557988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.558999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.559311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.561106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.574684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:23.577192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:23.578134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:23.578960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 220/438] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:23.585083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.618686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.633859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 219/439] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:23.640696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.720600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9cc1-4200-4ea0-9eb0-cf486837bf1b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.734471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.766426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001d11-9bb3-4793-8636-697e3882f03f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.769370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.772591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.772591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.772591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.772591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:23.772591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:23.773648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b9e35-3d51-42c0-a4e5-bc1830bbcf36 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:23.784673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 221/440] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:23.786357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c367b-6979-4180-a6b2-21146e6b3bf4 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.786701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c367b-6979-4180-a6b2-21146e6b3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.786984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c367b-6979-4180-a6b2-21146e6b3bf4 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.788292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 222/441] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:23.793413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c367b-6979-4180-a6b2-21146e6b3bf4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.812336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.813010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.813926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.813926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.815695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:23.817143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7492a13-342e-4fb0-8d30-10d6c5389fa8 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:23.818817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 220/442] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:23.820666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.820984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.823217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:23.843886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:23.844915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:23.896157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:23.926233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c367b-6979-4180-a6b2-21146e6b3bf4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:23.928424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 221/443] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:23.929855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:23.963581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:23.964201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:23.964482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:23.964762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.000926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.032313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.032593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6c1d-6019-48a0-ab3b-07c7ff164efe None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.033776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.069136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.069744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.070057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.070334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.071484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.072919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.074534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 222/444] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:24.075291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.116297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.134696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 223/445] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:24.135518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.183244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0477f-9445-4097-9d8b-3326d529fce3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.221418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.222073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.222352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.222626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.230680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.233779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:24.234626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3765903-1820-4b7f-b6ef-1a5dc4eea15c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:24.238867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:24.239870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:24.240942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 223/446] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:24.241647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.270655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.270655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.270655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.270655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.272481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=c8019a06791c4c888509f83d28e2ce55, scope.project.id=d809accf9a214c6185035b2a89a98317) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:24.272481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.272481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.278154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 224/447] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=c8019a06791c4c888509f83d28e2ce55 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:24.278930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.346485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.362312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc6b8-d1be-45d6-a1de-ce899987d463 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.398940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.399701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.399984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.400264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] PATH_INFO: `/v3/projects/d809accf9a214c6185035b2a89a98317` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.401509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] RBAC: Authorizing `identity:get_project(project_id=d809accf9a214c6185035b2a89a98317)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.403043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.404750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 224/448] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/projects/d809accf9a214c6185035b2a89a98317 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:24.410525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.411958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9383f-d15d-47eb-80cf-2943353a1444 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.456927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.457566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.457878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.458161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.458899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:24.459211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.461155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.474040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 225/449] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:24.477320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.497163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.536813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd88a-3e0b-40e0-9687-9cf4c8c188bb None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.582820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.583478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.583742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.584015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] PATH_INFO: `/v3/groups/3b911a70b29144e3884005e43b2a282e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.585192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] RBAC: Authorizing `identity:get_group(group_id=3b911a70b29144e3884005e43b2a282e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.587452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.591007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 225/450] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/groups/3b911a70b29144e3884005e43b2a282e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:24.594867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.612521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce331-cea3-42ea-9218-45b285997cac None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.624604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.654591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.655218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.655500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.655777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.702990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e382f-a7c7-4e78-8b66-85e13bfdfb42 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.722590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.724069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.737253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.737890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.738172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.738449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.739230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] RBAC: Adding query filter params (group.id=3b911a70b29144e3884005e43b2a282e, role.id=3b97713662114efa802df415a01374b4, scope.project.id=d809accf9a214c6185035b2a89a98317) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:24.739538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.741184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.744233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:24.761839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 226/451] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/role_assignments?group.id=3b911a70b29144e3884005e43b2a282e&scope.project.id=d809accf9a214c6185035b2a89a98317&role.id=3b97713662114efa802df415a01374b4 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:24.828755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 226/452] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 12:38:24.834670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.938619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eccc5-ce5e-4f0d-a8d0-060c4d1cff66 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:24.972732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:24.973366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:24.973653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:24.973958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] PATH_INFO: `/v3/projects/269bfb061a4341bbbc905a39cb4bf398` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:24.975108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] RBAC: Authorizing `identity:get_project(project_id=269bfb061a4341bbbc905a39cb4bf398)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:24.976647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:24.978455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 227/453] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/projects/269bfb061a4341bbbc905a39cb4bf398 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:24.983768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:24.995849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:25.090728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c3a-de6a-4910-a734-d75db1d6f6e1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:25.124011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:25.124647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:25.124931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:25.125209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] PATH_INFO: `/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:25.126402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] RBAC: Authorizing `identity:get_group(group_id=0a48d7da9d7549f793a6a1aaa74daa6e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:25.127847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c956-2754-4c85-a4d1-f58d95a52518 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:25.129411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 227/454] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Jul 26 12:38:24 2022] GET /identity/v3/groups/0a48d7da9d7549f793a6a1aaa74daa6e => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:25.135830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:25.201588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:25.234311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290afea-4891-46ee-a399-e807bc81bac6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:25.267551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:25.268150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:25.268428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:25.268701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:25.269471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] RBAC: Adding query filter params (group.id=0a48d7da9d7549f793a6a1aaa74daa6e, role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=269bfb061a4341bbbc905a39cb4bf398) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:25.269775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:25.271225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8244dff-f176-4d43-af42-9f4489f6593a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:25.277004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 228/455] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Jul 26 12:38:25 2022] GET /identity/v3/role_assignments?group.id=0a48d7da9d7549f793a6a1aaa74daa6e&scope.project.id=269bfb061a4341bbbc905a39cb4bf398&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:27.764942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cb2d-0ee9-4d97-ae23-9cfee86abd63 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:27.765803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cb2d-0ee9-4d97-ae23-9cfee86abd63 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:27.766247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cb2d-0ee9-4d97-ae23-9cfee86abd63 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:27.768031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 228/456] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:27.772896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055a13-5a0e-4636-a566-17c9d2d7c5f2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:27.773671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055a13-5a0e-4636-a566-17c9d2d7c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:27.774108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055a13-5a0e-4636-a566-17c9d2d7c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:27.798828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d0055a13-5a0e-4636-a566-17c9d2d7c5f2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:27.800271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d0055a13-5a0e-4636-a566-17c9d2d7c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:27.868739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 229/457] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:27.903866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34cb2d-0ee9-4d97-ae23-9cfee86abd63 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.003711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.040447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34cb2d-0ee9-4d97-ae23-9cfee86abd63 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.096393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d533-6dbb-4197-a056-f6dcbc6cde14 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.096805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d533-6dbb-4197-a056-f6dcbc6cde14 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.096978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d533-6dbb-4197-a056-f6dcbc6cde14 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.097920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.098301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 230/458] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:28.099402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.099915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.100408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.110810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.111456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.111940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.125557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.127064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:28.134079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:28.135529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:28.149873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:28.150769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:28.151631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:28.151631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:28.151631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:28.151631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:28.158121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 229/459] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:28.158955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.202439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.210706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 231/460] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:28.271112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.288461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489d90e-28aa-463b-8ac1-11067bfada54 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.322361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.330671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.331538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.332054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.332636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.334119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:28.334800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.337539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:28.375493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 230/461] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:28.383535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.469367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba903e7-57c1-4f93-9e32-a93c97f2e516 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.510760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.512064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.512493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.512971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.527817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1377-858a-4414-9286-bf7cd4d307fa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.528154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.530983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-91ca227b-73a4-4535-a0d2-217e8660fb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:28.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:28.554651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:28.555728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:28.555728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:28.555728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:28.555728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:28.558578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 232/462] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:28.560056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced88cb-e935-448d-ad86-8cb4e1a9fdf8 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.560531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced88cb-e935-448d-ad86-8cb4e1a9fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.560950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced88cb-e935-448d-ad86-8cb4e1a9fdf8 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.562584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 233/463] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:28.565446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced88cb-e935-448d-ad86-8cb4e1a9fdf8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.577932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.578539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.578824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.579102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.579792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.581245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a022-e093-4227-aeb1-8fa4a1415c0b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:28.608878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 231/464] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:28 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:28.610461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.610951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.611424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.627778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.631220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:28.633647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:28.701252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced88cb-e935-448d-ad86-8cb4e1a9fdf8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.750204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.753089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.754578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.754771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.756233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:28.756542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.758175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.760690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:28.785934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 234/465] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:28.790240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.794203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 232/466] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:28.827360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:28.946571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63a92-bd95-424b-b1f1-f29d30c3429c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.950660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:28.964626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3b00-72b2-4e11-b2d0-0af776ea067c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:28.996003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:28.996631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:28.996914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:28.997194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:28.997900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:28.999349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbc756-dd82-4b09-a429-e15287352112 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.012085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.013176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.013661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.014067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.026212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.027450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.029958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 235/467] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:28 2022] POST /identity/v3/users => generated 246 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:29.031597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4954-0058-4e67-8d10-85a4589bfaed None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.032101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4954-0058-4e67-8d10-85a4589bfaed None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.032679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4954-0058-4e67-8d10-85a4589bfaed None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.034772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 236/468] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:29.042644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.043254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.043739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:29.045111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:29.046000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:29.046888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:29.046888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:29.046888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:29.046888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.048097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 233/469] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:29.053714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.092052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:29.093641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:29.127112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:29.202631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 237/470] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:29.228132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.251354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3ec3b-374b-44d9-b211-1df53376aed5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.298222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.299231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.299976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.300462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.301974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:29.302323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.303722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.321107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 234/471] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:29.328299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.359192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:29.374347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd3dc8-922d-41be-99e0-140df4c09558 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.430633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.431293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.431636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.431915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.444145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:29.445508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.447027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.458304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f446-bc69-470f-ae09-9ac4a0729953 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:29.465526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:29.466455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:29.467302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:29.467302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:29.467302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:29.467302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:29.470004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 238/472] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:29.472952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.512938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.513566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.513872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.514149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.514833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.516287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282c16-ab38-4169-bb38-a49972686e74 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.561995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 235/473] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:29 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:29.594082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc43e-8a21-4f77-be93-cd770196fdf7 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.594398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc43e-8a21-4f77-be93-cd770196fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.594649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc43e-8a21-4f77-be93-cd770196fdf7 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.597007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 236/474] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:29.602020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.602366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.602716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.631074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ec568-de72-4fee-9bbf-ad5113f0d59f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.639502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:29.640739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:29.669076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.669711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.670050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.670436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.671245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:29.671565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.672959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.686890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 239/475] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:29.695120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.710811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:29.748278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 237/476] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:29.782175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:29.855121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc0ec-880d-42dd-abdd-cc93bf1af849 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.881690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:29.898339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.899190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.899647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.900085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.901000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.902592 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.913507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96be35-4631-4bfe-9df3-2034aa705e95 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:29.927179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 240/477] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:29 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:29.957188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:29.958013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:29.958366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:29.958710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:29.959654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:29.961374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:29.970313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.sql.core [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 12:38:29.970313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 12:38:29.970313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [parameters: {'id': 'f6cac534aa574134940ca491c7c0ac4c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 12:38:29.970313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result.read() Jul 26 12:38:29.988409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:38:29.989337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application yield resource Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise self.value Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application session.commit() Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 12:38:29.990568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.session.flush() Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application compat.raise_( Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 12:38:29.991522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:38:29.994148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result.read() Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:38:29.995159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [parameters: {'id': 'f6cac534aa574134940ca491c7c0ac4c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:29.996133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 12:38:29.997143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:29.998152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 238/478] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Jul 26 12:38:29 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:30.004739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:30.079895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:30.131220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881cb-4ece-4b08-b31e-65cf994382c6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:30.167677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:30.168322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:30.168601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:30.168874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:30.180770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-45ac647b-f737-4501-abef-f522d90e3b0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:30.186317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:30.187229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:30.188070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 241/479] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:38:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:30.193401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:30.301474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8997-2b24-46f2-be27-0f05f1e525fb None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:30.337190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:30.337843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:30.338112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:30.338387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:30.339104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:30.339408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:30.340774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb1e6-9c88-4a54-a94b-013a17d1779e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:30.345999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:30.350796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 239/480] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:31.078842 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d730-47a2-4c2a-b05e-d92342be4325 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.079362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d730-47a2-4c2a-b05e-d92342be4325 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.079362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d730-47a2-4c2a-b05e-d92342be4325 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.080970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 242/481] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:31.086555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.087106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.087106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.110602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:31.111790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:31.199649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 240/482] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:31.234450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d730-47a2-4c2a-b05e-d92342be4325 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:31.380169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d730-47a2-4c2a-b05e-d92342be4325 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:31.404074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:31.425933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:31.426900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.427408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.427886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.439713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-15ceafe5-f0cc-4ba2-8624-499f6ff2dccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:31.445096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:31.446163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:31.446975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:31.449574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 243/483] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:31.458905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:31.565446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed6d5-5a85-4fb4-93f7-1ce1bd2b8cf1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.566128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed6d5-5a85-4fb4-93f7-1ce1bd2b8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.566613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed6d5-5a85-4fb4-93f7-1ce1bd2b8cf1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.568425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 244/484] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:31.574409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.574953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.575429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.594348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:31.595882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:31.614580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145bad-f4f5-4f33-a961-750536e93d95 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:31.666252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:31.678318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:31.679019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.679309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.679596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.680329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:31.680639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:31.682069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:31.700220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 241/485] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:31.705227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:31.728675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 245/486] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:31.792965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:31.882546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7c9ff-fb7e-422f-851f-4ca53de7098f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:31.942413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:31.943033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:31.943402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:31.943692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:31.958462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006588c-6f1a-4763-a5a3-c3588cdde365 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:31.968190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:31.969680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:31.972276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:31.991027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:31.992359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:31.993844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:31.993844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:31.993844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:31.993844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:31.994083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 242/487] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:31.999891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.021887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.028410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.028704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.028991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.056487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:32.062733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:32.064785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:32.066889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 246/488] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:32.073249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.106190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.204158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9035240-6923-41db-90eb-b2cb5215a1a2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.242927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.243581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53ba07-e394-4c15-a978-0013f7fc76d7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.244517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.245113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.245608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.246593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:32.247111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.248861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd646e-ee71-4cee-a9c9-ba39298ab7d8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.264231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 243/489] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:32.265957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb9bb-3c9a-420c-9ce9-407c3e960165 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.266443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb9bb-3c9a-420c-9ce9-407c3e960165 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.266948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb9bb-3c9a-420c-9ce9-407c3e960165 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.268591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 244/490] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:32.274676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fb9bb-3c9a-420c-9ce9-407c3e960165 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.286663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.287970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.288763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.289252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.290174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:32.290900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.293261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac9b3e-aff2-4a34-9a18-64ca55f5814c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.305627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 247/491] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:32.311712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.311999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.312275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.331076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:32.332276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:32.358804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.417830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 248/492] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:32.417830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.422536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fb9bb-3c9a-420c-9ce9-407c3e960165 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.426803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.480073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.481299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.481767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.482519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.492935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.495313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:32.513767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:32.514736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:32.515641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:32.518437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 245/493] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:32.519884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.547449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d7ee2-f6cf-48a4-ad9c-1cf528b0ffcf None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.591743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.592413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.592697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.592971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.604162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.605672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:32.620979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:32.622183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:32.623060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:32.623060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:32.623060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:32.623060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:32.626717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 249/494] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:32.627576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.643886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.668034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1c87-4bac-4664-bcff-25a6708c76a6 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.705001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.706069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.706561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.707060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.719214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:32.724986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:32.726000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:32.726815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:32.727423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 246/495] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:32.728035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.737573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584de66-26ec-4983-b223-9ef0e5b3bfe5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.757660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.774968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.775677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.776028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.776304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.777099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:32.777405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.778977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba25094-f96a-4f1d-9d21-fcb290241f5d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 250/496] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119d3-898e-426a-81f2-338b8b0cee8f None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119d3-898e-426a-81f2-338b8b0cee8f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119d3-898e-426a-81f2-338b8b0cee8f None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 251/497] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:32.821458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812119d3-898e-426a-81f2-338b8b0cee8f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.848634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7629-507c-4127-a0dd-4b7cbe1c0dee None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.884934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.885712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.886121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.886466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.887266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:32.887602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.889053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.897549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:32.907426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 247/498] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:32.907426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:32.936374 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812119d3-898e-426a-81f2-338b8b0cee8f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:32.976545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:32.977432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.977895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.978330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:32.979137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:32.979446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:32.980830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9536a-353d-4e5c-ba52-a6cdfaff3455 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:32.994453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 252/499] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:32.994453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67888-70e7-4450-9906-a87003ede5db None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:32.994453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67888-70e7-4450-9906-a87003ede5db None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:32.994453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67888-70e7-4450-9906-a87003ede5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.003292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.009972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-17f67888-70e7-4450-9906-a87003ede5db None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:33.011210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-17f67888-70e7-4450-9906-a87003ede5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:33.021752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b997a-3f18-4cee-a1c9-c4b073444410 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.065743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.066397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.066675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.066949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.088563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 253/500] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:33.089533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67888-70e7-4450-9906-a87003ede5db None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.148821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.150326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7edc7f-05a2-4f48-acba-6caf17208526 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.151776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.189678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67888-70e7-4450-9906-a87003ede5db None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.223850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.224478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.224753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.225023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.232079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.233345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.233553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:33.246628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:33.248042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 254/501] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:33.248952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 248/502] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d127d5-b30a-4c09-aa15-a84653b95722 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d127d5-b30a-4c09-aa15-a84653b95722 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d127d5-b30a-4c09-aa15-a84653b95722 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 249/503] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:33.260184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d127d5-b30a-4c09-aa15-a84653b95722 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.348707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361154a-0754-4942-981a-6ed29e97baf4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.360117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d127d5-b30a-4c09-aa15-a84653b95722 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.371674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.383409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.384042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.384320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.384593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.393940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.394579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.394869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.395148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.396472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.398440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.405720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:33.410691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:33.411754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:33.412566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 250/504] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:33.413251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:33.414816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:33.416927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:33.416927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:33.416927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:33.416927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:33.417440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.417578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 255/505] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:33.417578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.464201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.514164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9765e2-969e-4ec5-bf0e-3ef19eaa71c5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.519155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11466e1-b994-4229-91f1-e76ff876b66d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.546415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.547045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.547327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.547611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.553100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.553711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.554580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.554863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.555802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:33.556115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.557564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.558662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.560092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1b326fbc-e372-44f7-b3cf-7fb495112acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:33.574676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:33.575713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:33.576836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:33.576836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:33.576836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:33.576836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:33.577947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 256/506] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:33.579325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.579617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.579970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.594604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 251/507] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:33.595432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.597346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:33.598585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:33.620163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.668014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 257/508] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:33.668838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.707659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d631e-365d-4f6e-b937-e0df5d1c6189 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.709187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.743351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.743966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.744251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.744529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.745246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:33.745555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.746971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.754777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 252/509] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:33.755659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.768146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbebb-37af-470a-97c0-87d649d89645 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.802964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.803569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.803910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.804221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.804904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:33.805204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.806589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.817557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 258/510] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:33.818361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.836467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.859468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532224-bdc6-46ef-b410-eaa0e996d430 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.892898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.893538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.893823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.894111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:33.894805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:33.895111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:33.896490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:33.908463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 253/511] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:33.909335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:33.926003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243975dd-2ad8-434f-801e-87324f38d3c2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:33.936375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:33.959885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:33.960528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:33.960896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:33.961180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.010393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191469f-087d-45b6-9354-3eb82857bc4e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.027774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.029173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.046214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83687948-9df2-4657-b35e-200422916733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.046866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83687948-9df2-4657-b35e-200422916733 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.047002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.047149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83687948-9df2-4657-b35e-200422916733 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.047421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83687948-9df2-4657-b35e-200422916733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.058474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83687948-9df2-4657-b35e-200422916733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.059964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83687948-9df2-4657-b35e-200422916733 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-83687948-9df2-4657-b35e-200422916733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:34.075088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:34.076113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 254/512] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:34.077212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83687948-9df2-4657-b35e-200422916733 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.131645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 259/513] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:34.132527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.159986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.182787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83687948-9df2-4657-b35e-200422916733 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.216352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.216998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.217291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.217572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.228220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.229682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.231480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db710ee-06e6-4a0b-b4aa-b0986aa27fb6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:34.244469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:34.245477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:34.246417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:34.246417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:34.246417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.246417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:34.246417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 255/514] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:34.247102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.250601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.268800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.269473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.269753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.270064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.277486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.279015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:34.290552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:34.291541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 260/515] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:34.292473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.350743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ad717-14b9-4eac-95dd-2d79ce4ce522 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.376780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.385035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.385674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.385989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.386269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.392790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.392928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2259e0-9c0b-4ce9-b618-1427ad99ff68 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.394276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:34.406607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:34.407655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 256/516] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:34.408717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.431095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.431711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.431994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.432267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.432953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:34.433255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.434628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.446973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 261/517] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:34.451027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.484916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.509292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc216a-3026-484e-9af1-8cdeb51b49c7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.542654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.543257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.543539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.543818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.551040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ea4b-8f53-4324-ad56-c3573a75f268 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.554405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.555873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:34.570443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:34.571476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 257/518] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:34.573005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.587703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.588320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.588602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.588876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.589562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:34.589898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.591259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.602638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 262/519] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:34.603418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.614820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.673358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172750b2-3060-4073-adf8-b51d1d705813 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.696910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.703060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5e8-6a01-47ea-920b-7f3de9090f8b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.706615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.707228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.707510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.707790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.708583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:34.708890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.711111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.728105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 258/520] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:34.728879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.741949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.742570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.742850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.743127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.743880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:34.744186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.745612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.763972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 263/521] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:34.764734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.824870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:34.828924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba124a08-6096-4f4e-af45-bf58fba0d47e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.864853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.865718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.866026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.866363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.867425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.868358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6f557-725c-4eb0-ac14-875ba91b0fce None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:34.868856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.888969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 259/522] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:34 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:34.888969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.914950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:34.915578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:34.916350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:34.916350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:34.916825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:34.917129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:34.918579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:34.933099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 264/523] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:34.933972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:34.956654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.017273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c02ef-7eb5-411e-9413-b08af43e8547 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.060981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.061545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151abd9-7f61-4a18-ada8-492ded1b1abd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.061714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.062046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.062321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.071524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.073336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:35.087368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:35.088286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:35.089334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 260/524] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:35.089945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.108051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.109467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.110180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.110809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.110809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.184960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.186620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.205872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.217038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baec847-3eba-4b58-9e7f-0eceea69917b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.254905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.255627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.255911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.256206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.258012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=6c2579707a174cd3ba2d235e6ec548bf) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:35.258238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.259713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.269843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 261/525] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/role_assignments?user.id=6c2579707a174cd3ba2d235e6ec548bf&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:35.269843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.309993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 265/526] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:35.310947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.371939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.399340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cba6a-e10b-4890-83c1-5fcd74efbd4e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.445292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.447475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.447475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.447475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.457310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.458828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.463475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df3c3-bbf8-435f-970e-33b69e597bb3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:35.474147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:35.475035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:35.476436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 262/527] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:35.476901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.489905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.515416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.516604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.517325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.518250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.519527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:35.520029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.522808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.551676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 266/528] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:35.551676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.616423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a887-6a5f-45d2-9813-423dfd5b5053 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.659719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d3df-22f7-4d6f-9b13-0daae0c7c5bd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.664267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.665125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.665579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.666151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.676468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.681458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.683270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:35.699173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:35.700274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:35.701369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:35.701369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:35.701369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:35.701369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:35.707264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 263/529] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:35.707264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.713694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.714523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.714941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.715350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.716791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:35.717244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.719288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.735472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 267/530] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:35.736482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:35.781823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.826869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117f85-a886-4f25-96ba-5f17069aa765 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.863438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.864201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.864624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.864970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.876165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e2140-2262-4a64-ad23-e70bc4cf4fa6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:35.923686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:35.924751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:35.925548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:35.926342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:35.927174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:35.927828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:35.928497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.931521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.941005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:35.942631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:35.952410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 268/531] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:35.953198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.067769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 264/532] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:36.068947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.078191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:36.086918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bc0d6-116d-40b2-9f09-b0d076109347 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.123668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.124459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.124968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.125228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.126275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:36.126624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.128115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.141985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 269/533] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:35 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:36.143172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.166755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:36.179372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b01c1-b050-47bd-8b0a-5806b0a07d88 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.226771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.228423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.228930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.229398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.246393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.248231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:36.272386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:36.273384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:36.274277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:36.275429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 265/534] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:36.281401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.358186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531d12-7bef-474b-98c1-c290f273ae8a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.426768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.427437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.427723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.428007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.450990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.452408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:36.480554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:36.481470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:36.482347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:36.482347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:36.482347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:36.482347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:36.482994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 270/535] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:36.489166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.505449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:36.518082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856423-1e06-4a63-8c9b-3935aa39a34f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.587600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.588244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.588531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.588815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.589580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:36.589916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.591380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.634392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 266/536] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:36.642177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.656887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:36.685089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c43e-10ff-47cc-8158-d03037ba5c77 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.755314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.757375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.760562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.761095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.762127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:36.762628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.765620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.792143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 271/537] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:36.815204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:36.835195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bcc50-91e9-4159-8354-6a8e078253a7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.905683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.906343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.906638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.906919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.907724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=2135e982052e41cc834c5c0a6608decc) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:36.908040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:36.909490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb20ae-6383-493e-a2f7-99c116e74084 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:36.913986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:36.921284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 267/538] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/role_assignments?user.id=2135e982052e41cc834c5c0a6608decc&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:36.949032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d120-a98f-495d-9a2c-8f9728f2d88e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:36.958519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553b7e-fb5c-4afb-8421-ac9b32e39faf None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.958831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553b7e-fb5c-4afb-8421-ac9b32e39faf None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.959088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553b7e-fb5c-4afb-8421-ac9b32e39faf None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.961004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 268/539] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:36.966808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.967641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.968126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.988144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:36.989262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:36.989948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:36.990209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:36.990313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:36.990764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:36.999827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:37.001288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:37.024691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:37.025571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:37.026467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:37.028393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 272/540] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:37.034285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.139382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 269/541] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:37.157191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1eb1d-3b09-435d-9cd2-1e011d745a28 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.174289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.181958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:37.197102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:37.209544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.211175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.211945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.213642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.215400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:37.218664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:37.220327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:37.246296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 273/542] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:37.254780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.318100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66494cee-20ff-4dc5-89e8-282f2ffd42a3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.354168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.354971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.355167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.355432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.370326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:37.376606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:37.377509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:37.378746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 270/543] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:37.383852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.444038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bf7-dbb4-4297-85c9-3d177e41711f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.488788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:37.496842 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.497825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.498222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.498605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.499499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=d12b699d6f6c4047a4b414e0ccff2e6e) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:37.499887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:37.501393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100ce71-709f-4bdd-a543-dcbc6b764b88 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:37.513839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 274/544] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/role_assignments?user.id=d12b699d6f6c4047a4b414e0ccff2e6e&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:37.513839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb0dc-552e-4dd1-b50f-559b563ea255 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.513839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb0dc-552e-4dd1-b50f-559b563ea255 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.513839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb0dc-552e-4dd1-b50f-559b563ea255 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.515606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 275/545] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:37.517331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.517698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.518090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.538407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:37.539934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:37.564533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b8a9-b5b5-4c17-94ff-813807504ca5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.620943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:37.649559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.650232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.650515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.650791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.651573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:37.651881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:37.653282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:37.662757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 276/546] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:37.670986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 271/547] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:37.676607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.692894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.848250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67b84-7064-421d-aba1-3b6b54c3e876 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.884144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d27030-38f2-4b59-91f5-4ebf794b06ce None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:37.887907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.888762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.889186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.889601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.902399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:37.904550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:37.922900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:37.923947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:37.925002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:37.925002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:37.925002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:37.925002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:37.927200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 277/548] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:37.933229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:37.948836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:37.962727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:37.963672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:37.964803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:37.965421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:37.985181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:37.996201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:37.997409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:37.998839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:37.999640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 272/549] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:38.006617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.008523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.087262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2e232-0769-4093-997d-72d0ef89b026 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.139548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.140041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.140326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.140605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.141361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:38.141715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.143125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.163099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73722-f20c-471f-993b-5c6fa869cc41 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.167739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 278/550] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:38.173319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.199509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.200507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.200997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.201478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.202449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:38.202990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.204597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.213887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 273/551] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:38.219072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.277315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.334376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3e1d-c723-4233-8730-ec44a421c446 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.372057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.373051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.373540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.374516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.386431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.388396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:38.405156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:38.406173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:38.407180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:38.407180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:38.407180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:38.407180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:38.409358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 274/552] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:38.416694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.440338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.451730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27a58-8150-45de-bace-df34fe318222 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.521296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.521987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.522276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.522728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.526664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60d6e4-aa83-478b-9b29-e8f5a5ed0102 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.534173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.539640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.541107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:38.563122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:38.564098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:38.565026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:38.566527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.567383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.567880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.568355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.569014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 279/553] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:38.569970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:38.570631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.572233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3741fc-a7c4-45f3-8571-ad477a603610 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.574846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.586387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 275/554] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:38.587920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ae5-e496-4aab-adfc-892e75f65d0c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.588417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ae5-e496-4aab-adfc-892e75f65d0c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.588923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ae5-e496-4aab-adfc-892e75f65d0c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.590613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 276/555] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:38.592780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7ae5-e496-4aab-adfc-892e75f65d0c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.686605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c3e10-a3e7-4ed6-b869-92a1afa3720a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.699239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7ae5-e496-4aab-adfc-892e75f65d0c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.723284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.723911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.724193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.724472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.725430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:38.726352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.727801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b55297-d8f1-4b40-b260-26c74e607110 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.737028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.737975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.738465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.738959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] PATH_INFO: `/v3/users/glance` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.746922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.748030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 280/556] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:38.748964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:38.749275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.749568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.749915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:38.762228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:38.763297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:38.764697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:38.767317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 277/557] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:38.768328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.768844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:38.770106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:38.784276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.793092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:38.858098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 281/558] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:38.859130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:38.876362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142e40-5603-45e9-aacb-0bfbe7ab139d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.914340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:38.915351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:38.915858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:38.916341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:38.982813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae969db-4132-43ec-88e7-3690dd3c9f8e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:38.992014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:38.993873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.016087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.025034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.025034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.025034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.025034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.025418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:39.025418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.026625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.045704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 282/559] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:39.046668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.056796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.124215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 278/560] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:39.125381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.157740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4564-4b06-4680-97f9-e0a7858e18d3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.197784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.198558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.198846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.199123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.210053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:39.215635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.216581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:39.217431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 283/561] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.218895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.239066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab35bc-2921-4f1c-97f3-8f39ab430678 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.262384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.281279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.281951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.282234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.282769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.292215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.294592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.296030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a2a62ac5-e913-4459-b50e-2c6399ae3809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:39.311692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.312618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.313519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:39.313519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:39.313519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.313519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:39.313519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 279/562] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.314548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfaa4-76a8-4ac4-af71-5e87f64452b3 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.314548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfaa4-76a8-4ac4-af71-5e87f64452b3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.314548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfaa4-76a8-4ac4-af71-5e87f64452b3 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.315922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 280/563] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:39.320987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbfaa4-76a8-4ac4-af71-5e87f64452b3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.341345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93a86-69dc-402d-acec-08d262c3c8cd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.379136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.379771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.380048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.380319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.391318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.392762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:39.412912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.414528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.415559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:39.415559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:39.415559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.415559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:39.422137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 284/564] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.423322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.450487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbfaa4-76a8-4ac4-af71-5e87f64452b3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.486401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.487019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.487309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.487590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.488314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:39.488623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.490075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ede22-2b40-4d95-88cd-85a8f91f8d7f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.498337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 281/565] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:39.499518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.499803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.500080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.518742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:39.519937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:39.536021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e5ae-9fdf-403a-ad2c-b3e801142b55 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.546958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.555171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.579133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.580153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.580706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.581159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.582020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:39.582494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.584236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.591504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 282/566] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:39.592345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.598209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 285/567] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:39.599239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.706342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41228-ae74-4aa9-895d-c4b46d34ef12 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.708596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d42f9-216e-4c7a-9349-7140bd21d7a3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.744627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.745136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.745261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.745424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.745702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.746425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:39.746590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.746747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.747205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.747667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.748099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.758839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.759408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 283/568] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:39.760215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.760937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:39.779869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.780821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.781734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:39.781734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:39.781734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:39.781734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:39.781734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 286/569] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.782665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.795722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.813269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:39.877697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21165e-f1e4-44e6-ab78-1cdc8cc9f55e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.899123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ec7e-45a2-46e7-b326-11f849179e3a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:39.910703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.911347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.911627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.911900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.919156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:39.920599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:39.932387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.933436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:39.934732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:39.935267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:39.935267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:39.935267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:39.935511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 284/570] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.935511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:39.937343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:39.949001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:39.954415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:39.955556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 287/571] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:39.956427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.022351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.042332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.045112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa46f-ef54-422a-a9d0-c53c4c1b6c80 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.058380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0015-6b7a-4272-9532-5ee364f23fca None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.078171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.078804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.079089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.079365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.086652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.088079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.092048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.092660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.092943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.093216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.093929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.094235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.095567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-7bf35edb-5afa-4aef-bfed-c16a00a6cbde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:40.099117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:40.099986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:40.101489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 285/572] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:40.102439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e055c-aa89-4ca6-bcda-b7e87db4093e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.102537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e055c-aa89-4ca6-bcda-b7e87db4093e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.102797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e055c-aa89-4ca6-bcda-b7e87db4093e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.104142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 286/573] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:40.105840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e055c-aa89-4ca6-bcda-b7e87db4093e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.109516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 288/574] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.110362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.206742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e055c-aa89-4ca6-bcda-b7e87db4093e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.212073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced802-59ce-42c2-8059-607c6ec5404d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.239990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.240861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.241654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.241989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.242821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.243130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.244553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.245725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.246362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.246643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.246928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.247641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.247949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.249296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b837-99f9-48bc-b211-f0517dce9ae3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.256199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 287/575] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.257081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.257624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 289/576] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.258705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.258995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.259269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.264896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.281694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:40.282856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:40.284804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.350342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 290/577] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:40.351760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.364405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16e17a-4e9d-4dea-9a47-a33669c3f832 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.399064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.399689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.399971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.400248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.400997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.401304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.402767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.414682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 288/578] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.415440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.469282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a285-d96b-4416-964f-08b9bc363b8f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.476551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.505218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.505873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.506152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.506432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] PATH_INFO: `/v3/users/nova` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.513303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.514760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.515633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e927d-bd61-4cc3-bef8-1c661141ca69 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.516446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:40.527793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:40.528844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 291/579] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:40.530140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.552036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.552634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.552919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.553201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/6c2579707a174cd3ba2d235e6ec548bf/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.567565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=6c2579707a174cd3ba2d235e6ec548bf, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.569016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.582062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 289/580] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:40 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/6c2579707a174cd3ba2d235e6ec548bf/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:40.582846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.640342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d04b24-4353-46e7-bdb1-d84a18062ead None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.676972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.677626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.677933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.678229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.689676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.691239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.699440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470a0bc-950a-440e-a38a-ba19e0609000 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:40.707260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:40.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:40.709409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:40.709409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:40.709409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:40.709409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:40.709409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 292/581] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:40.709690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.721824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.753796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.754716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.755154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.755582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.767522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:40.769002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:40.775411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:40.776400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:40.777270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 290/582] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:40.778015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.830951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be6b7-1c8a-4a85-815f-413c1d9bc382 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.867138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.867821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.868102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.868378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.869163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=182ee307b1394f72bc71477eb027da49) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.869473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.870904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.876566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 293/583] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/role_assignments?user.id=182ee307b1394f72bc71477eb027da49&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.877157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:40.895724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4ecb-8880-499e-90e8-0a77eedefc37 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:40.948738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:40.949376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:40.949662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:40.949991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:40.950812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:40.951125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:40.952602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:40.973485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 291/584] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:40.974469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.011798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.028346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853898c-74d8-4b6f-9692-3aeffbb65b39 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.054219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.076047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.076675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.076961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.077260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.078274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:41.078586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.080160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.097924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 294/585] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:41.098780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.100440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfa338-102a-4af8-8036-4f06ded39610 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.141523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.143673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.143673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.143673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.143673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:41.144006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.146121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.161280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 292/586] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:41.161280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.235606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e5e2-7b1d-4a6d-bac1-b99904eb6fa3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.274969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.275977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.276459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.276927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.288823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.290704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.296113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.306030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f248fe8-9446-45d7-8015-f1d59aafd5ff None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:41.308200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:41.309115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:41.310436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:41.310436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:41.310436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.310436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:41.312387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 295/587] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:41.313476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.344651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.345886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.346505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.347063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.348726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.359096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.361641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:41.376522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:41.377517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:41.378582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:41.381240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 293/588] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:41.383000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.442105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad0a6-488f-42c4-bace-3499beebc33e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.495332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.496149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.496528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.496909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.505384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e3c-3316-4324-9baf-8a3b51367e6d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.508824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.510447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:41.526497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:41.527616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:41.528815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:41.528815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:41.528815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.528815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:41.535124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 296/589] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:41.535124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.556375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.557367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.557969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.558456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.559786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:41.560464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.562292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.579778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 294/590] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:41.581089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.598399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.638182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.666370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68214-83b0-4a1a-a458-7a63cf6bc024 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.705778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.706442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.706721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.707085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.707838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:41.708184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.709594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.710079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865a44-63f3-449e-9a05-472816bc61bd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.735241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 297/591] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:41.736201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.759028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.759941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.760403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.761382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.762594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:41.763090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.765576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.783278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 295/592] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:41.783278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.859671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80eb81-4c97-4923-bf65-2295e9ef1a0e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.870648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.902167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cd26-0590-4872-9e3a-99c14e712eb4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:41.902659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.903298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.903574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.903846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.907398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:41.912776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.914412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:41.926853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:41.927777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 298/593] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:41.929831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:41.952478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:41.954039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:41.954566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:41.955314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:41.970439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:41.972161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:41.993310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:41.994333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:41.995230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:41.995230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:41.995230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:41.995230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:41.998169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 296/594] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:41.999453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.061044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d698-62c4-46e4-aaa5-9ebe6b01c549 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.109875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.110924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.111302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.111731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.122031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d0ad-47a5-4b68-a261-3c9b9f90a1a5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.122523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.124220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:42.144150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:42.145168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 299/595] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:42.146532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.154623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.166039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.166975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.167502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.167978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.168999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:42.169542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.171301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.185437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 297/596] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:42.186769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.223042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.281654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d294-5a8d-48db-988b-d524b9daebcc None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.298356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da04ce-6ed9-498a-be06-ea1152ba0b3c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.325793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.326597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.326884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.327162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.328184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:42.328503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.330164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.337216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.338189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.338675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.339173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.340176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:42.340686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.342430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.344437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 300/597] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:42.345490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.363004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 298/598] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:42.364273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.416536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.474874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186c742-6954-4491-8f5e-88321decdb0e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.476723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f278420-722f-4dca-a2cc-3229bce0ad99 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.497206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.517425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.518754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.518970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.519392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.519704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.520006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.520168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.520548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.529096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.530979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.539127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=b9dd08e0da964403bf7d7e2b34669efb, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.540677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:42.544914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:42.545933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:42.546842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 299/599] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:42.547796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.567177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 301/600] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:42 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:42.569134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.674195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796777a2-ec29-404e-95e4-41e5d8b7f650 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.677699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.717298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.718181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.718561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.718937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.719475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9cc1e-887f-42f4-b7b3-aec7108bfd8e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.738564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.740318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-84912899-89ed-4daa-bd2c-14c0ddafd7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:42.760243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:42.762126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 300/601] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a68c-8a8b-4e8b-8f23-38de59ee4922 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.764248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a68c-8a8b-4e8b-8f23-38de59ee4922 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.765150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a68c-8a8b-4e8b-8f23-38de59ee4922 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.765312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.765491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.769834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.769834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.769834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:42.769834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.769834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea1ab-2472-4ad8-8c55-50f30fb05025 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.770648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 301/602] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:42.770794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883a68c-8a8b-4e8b-8f23-38de59ee4922 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.786253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 302/603] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:42.787833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.788187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.788468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.808767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:42.810094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:42.836164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:42.889013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 303/604] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:42.890207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.905463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883a68c-8a8b-4e8b-8f23-38de59ee4922 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:42.947101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:42.947648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:42.947933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:42.948210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:42.949078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:42.949392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:42.951775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:42.966491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 302/605] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:42.967388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:42.986993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.010483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e1530-0ffc-46b7-86fd-2da1003f4d52 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.047705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.048648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.048930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.049204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/2135e982052e41cc834c5c0a6608decc/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.064754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=2135e982052e41cc834c5c0a6608decc, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.066224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3d57e-bc98-4b1c-93ce-0c53bc0ec2c1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.081596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 304/606] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:42 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/2135e982052e41cc834c5c0a6608decc/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:43.082928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221c26-617f-44e6-ad4e-a27df882da54 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.083216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221c26-617f-44e6-ad4e-a27df882da54 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.083492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221c26-617f-44e6-ad4e-a27df882da54 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.085466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 305/607] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:43.086738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221c26-617f-44e6-ad4e-a27df882da54 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.101552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.106049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808e46-b18a-4cdb-9da6-fc8288229b67 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.151756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.152731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.153018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.153297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.169768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8fbd709e-79dc-41d8-b9c4-a50eb2452f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:43.176632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:43.177661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:43.178600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:43.180483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 303/608] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:43.181386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.181679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.181985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.205953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:43.207428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:43.214482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221c26-617f-44e6-ad4e-a27df882da54 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.264422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.265860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.266172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.266449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.275807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.277551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:43.293228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:43.294306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:43.295218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:43.295652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 306/609] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:43.296255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.304335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 304/610] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:43.305225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.314364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.395085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.433719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e673d-0e15-4fe3-87e6-0f36e341ce1b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.437278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d956-5405-441b-8b45-1ee40f38632c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.478989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.479531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.479816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.480095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.480818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:43.481127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.482540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.489296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.490222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.490994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.492041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.492542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 307/611] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:43.493368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.493626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:43.494225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.495925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.513915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 305/612] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:43.515096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.587044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.609440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a870-4a32-4a27-be7f-a7dc6cc15a75 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.625943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bca3c-6710-4e24-bfde-f429de499a85 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.645942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.657302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.658254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.658543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.658824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.666966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.668066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.668583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.669062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:43.679232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:43.680118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:43.681046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:43.683323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 308/613] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:43.684163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.685270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.686935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:43.707356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:43.708280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:43.709622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:43.709622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:43.709622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:43.709622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:43.709622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 306/614] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:43.711346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.793208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a218-0f88-45fe-b06d-b2b7b4f6359e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.829134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.830100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.830487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.830861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/d12b699d6f6c4047a4b414e0ccff2e6e/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.843484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906687c9-beb6-440c-88a2-d8c6b38f7386 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:43.848752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=d12b699d6f6c4047a4b414e0ccff2e6e, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.850362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.865030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:43.872725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 309/615] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:43 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/d12b699d6f6c4047a4b414e0ccff2e6e/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:43.874035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.889137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:43.889773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:43.890160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:43.890443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:43.891169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:43.891476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:43.893024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:43.903787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 307/616] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:43.911384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:43.929956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.045894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f665ff-6936-41e2-a14b-b7801f517f38 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.073564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ee6b6-f68c-4b9f-afb3-bf62734745ae None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.089936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.091212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.091743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.092130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.106189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.108086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.120056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.120677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.120953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.121223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.121999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:44.122303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.123718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:44.127533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:44.128616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:44.129737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:44.129737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:44.129737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:44.129737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:44.131900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 308/617] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:44.137208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.139929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 310/618] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:44.146810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.172750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.246995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67aa01-8a25-429f-ab3a-68653d6cd6d3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.259898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.265020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f5a-25b2-4e14-9125-1fe2a406e4f8 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.283688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.284660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.285096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.285513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.286397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:44.286849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.288951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.302225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 309/619] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:44.304192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.304994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.305347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.305691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.307192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.314825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.316449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:44.328988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:44.330161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:44.331128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 311/620] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:44.336069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.407977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.419930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fa3b-89a9-49d8-ba9c-c1cc1352c8f4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.453760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097dca-0629-41f5-a3bc-9ce6f4d8e800 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.454510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.455257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.455647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.456036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.463719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.465438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:44.478161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:44.479356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:44.480419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:44.481228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 310/621] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:44.486342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.497269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.498285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.498745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.499195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.500315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:44.500824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.502598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.523472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 312/622] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:44.535306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.567364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.591646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f4060-8a5e-4b65-8415-60a52c54ead0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.626481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.627192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.627545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.627891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.628753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:44.629148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.630690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.649714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 311/623] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:44.655092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.663714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bf607-44d2-4139-8d74-b561107e153a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.667861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.703420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.704488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.704949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.705401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.764898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55cfa2-b2b4-4e4e-9fd3-b9fc34707318 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:44.782284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.784173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.802629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:44.803302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:44.804128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:44.804409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:44.805116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.817859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:44.819304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:44.837737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:44.838710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:44.839618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:44.839618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:44.839618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:44.839618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:44.839618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 312/624] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:44.843493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:44.956836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 313/625] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:44.960668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:44.962309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.012376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf2c1-88e6-44d4-8dc1-44cb843fc0c6 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.048655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.049531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.050046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.050500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.051375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:45.051863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.053429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e4b4-e843-4407-b1d1-890c9d41e96f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.067068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 313/626] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:45.068748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c3f32-6d17-4c04-b06c-f13393fccfc3 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.069258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c3f32-6d17-4c04-b06c-f13393fccfc3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.069722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c3f32-6d17-4c04-b06c-f13393fccfc3 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.071916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 314/627] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:45.072855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c3f32-6d17-4c04-b06c-f13393fccfc3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.088111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4dc7-e5bd-4524-ac88-5438201d713a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.107256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.128810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.129465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.129733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.130051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.142324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.143777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-90bcdf57-4cb4-4dad-9017-eae304c69f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:45.160919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:45.161925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:45.163372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:45.163372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:45.163372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:45.163372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:45.163372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 314/628] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:45.163958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.164246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.164527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.184679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:45.186003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:45.189587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c3f32-6d17-4c04-b06c-f13393fccfc3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.215453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.228354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.229210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.229668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.230111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.237338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.238988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:45.251153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:45.252255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:45.253403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:45.255451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 315/629] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:45.256436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.262109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 315/630] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:45.270735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.362370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514525c-4a01-4d74-b34a-79015436ce91 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.392655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.398164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504882ff-25c0-417e-81cd-4bd79df9fd6d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.399160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.400142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.400591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.401848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.402709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:45.403171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.404692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.420390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 316/631] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:45.421974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.437986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.438690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.439254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.439405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.440188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:45.440549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.442063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.456587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 316/632] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:45.457640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.479765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.552398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fe4f-1b9d-4691-ba86-8c9e3a1f4fba None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.569338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441248b-2a75-4576-b029-c969673dc1cc None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.590442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.591505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.591794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.592335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.603569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:45.605819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.606459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.606737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.607009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:45.608408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:45.609342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:45.610265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 317/633] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:45.611023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.620510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.622015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-c9a72742-5f9c-4973-a9c2-6e85579a0ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:45.634934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:45.635836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:45.636760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 317/634] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:45.637256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2224b4-aaa8-4d8d-a755-b5d11b1cd5a5 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.637767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2224b4-aaa8-4d8d-a755-b5d11b1cd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.637984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2224b4-aaa8-4d8d-a755-b5d11b1cd5a5 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.642062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 318/635] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:45.643402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2224b4-aaa8-4d8d-a755-b5d11b1cd5a5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.663907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.729246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068484f0-cc62-483d-8f82-09a072caab68 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.731003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.756858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2224b4-aaa8-4d8d-a755-b5d11b1cd5a5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.767352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.768027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.768315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.768607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/182ee307b1394f72bc71477eb027da49/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.784171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=182ee307b1394f72bc71477eb027da49, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.786362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.793431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.794082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.794365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.794648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.795434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:45.795755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.797123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6caed-76da-4001-9c71-7ea203cefd28 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.800575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 318/636] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:45 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/182ee307b1394f72bc71477eb027da49/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:38:45.801377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.813540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 319/637] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:45.815725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.816243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.816777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.843304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:45.845595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:45.930717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558cce5-b907-4a85-a8b3-9ccd4ce3b9c9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:45.956564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 320/638] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:45.958104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:45.971589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:45.976091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:45.976892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:45.977182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:45.977464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:45.978399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:45.978717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:45.980219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:45.995694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 319/639] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:45.996567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.017113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.074350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a274-6555-4421-a788-6b7687b71cc4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.110430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.111100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.111386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.111660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.123283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.124632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdd394-3dc2-49cb-b431-1b41d912c3e0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.124763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:46.143354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:46.144370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 321/640] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:46.145952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.169351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.170075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.170359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.170638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.182155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:46.187581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:46.188596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 320/641] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:46.190710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.232320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.268000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.278456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc9ba-46a6-47b2-bb4c-07dd9d944d6d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.304626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c128817-41f5-4b9c-9e86-efab635bb660 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.313662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.314312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.314593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.314871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.315665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=6c2579707a174cd3ba2d235e6ec548bf) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:46.315977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.317394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.324012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 322/642] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/role_assignments?user.id=6c2579707a174cd3ba2d235e6ec548bf&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:46.324848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.344096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.344788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.345206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.345500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.346355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:46.346715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.348175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ec530-a9ec-4105-9a01-ca736e206029 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.364085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 321/643] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:46.365402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb1ab5-9254-4f73-95bb-60ff78c47ac0 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.366578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb1ab5-9254-4f73-95bb-60ff78c47ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.367118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb1ab5-9254-4f73-95bb-60ff78c47ac0 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.369027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 322/644] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:46.375379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.375727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.376586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.402228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:46.403754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:46.443228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4afd3-53cd-4c3c-9916-2b5d05880c17 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.472183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.482933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.483572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.483862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.484142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.484896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:46.485184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.486620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.488252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 323/645] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:46.489297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.508135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 323/646] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:46.514240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.573928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.627290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dbcab-5975-40c7-9801-b73cfa336718 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.653202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522a6-3597-4c39-817e-aefc6762bc3b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.672229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.672891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.673180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.673460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.681785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.683282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.689868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.690513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.690795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.691069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:46.696883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:46.697939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:46.698996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 324/647] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:46.699637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.702905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.704418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:46.719363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:46.721452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 324/648] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:46.723747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.766149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.812649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffb40-b09a-42f7-88f1-e6b5ca5833bd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.827448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afabfd-4735-4677-bc80-644c57a29abf None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.837692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.852122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.853004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.853464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.854029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.862709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:46.863131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:46.863413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:46.863689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:46.864485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:46.864788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:46.867141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:46.867467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:46.873307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:46.874516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:46.875599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:46.882639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 325/649] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:46.883662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.886134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 325/650] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:46.886967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:46.989094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:46.994360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1221fe-ffda-4250-828b-e551bbcd5909 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:46.997258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1feba-1556-437b-95eb-e2ddc0698e4c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.033082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.033712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.033981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.034103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.034269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.034997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:47.035311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.035416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.035886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.036379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.037219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.037507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:47.038281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.039901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.055256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 326/651] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:47.055256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.060030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 326/652] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:47.061257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.108341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.170309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85415-b9eb-4c53-a7aa-03e64460deaa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.175505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcfd85-ca08-4229-bce8-65cb48520d51 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.208163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.209170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.209690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.210297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.214337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.214953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.215233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.215509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.222254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.224013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:47.240386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:47.242219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:47.243253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:47.243253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:47.243253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:47.243253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:47.249846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.250122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 327/653] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:47.251381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.288684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.290465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.351127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.359996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290a0e-31f0-48c5-9144-08d7d546277d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.395795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.396847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.397494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.397770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 327/654] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:47.398283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.398689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.407195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.409035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:47.421993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:47.422984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:38:47.423944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:47.426698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 328/655] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:47.427753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.461169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.505759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6f8b-1325-495d-83d6-2e7fcc4bb93d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.539719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98af47-753e-4b51-93d5-ff4b5f8f951e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.543681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.544342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.544630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.544907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.545605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:47.545933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.547287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.564340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 328/656] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:47.564340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.583287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.584290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.585439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.585965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.597877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.599843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:47.616690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:47.617796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:47.618736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:47.618736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:47.618736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:47.618736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:47.620960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 329/657] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:47.622123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.631940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.673999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ff26-1e70-4855-941b-fbb75a5d27c2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.697295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.713119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.714089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.714556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.715009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.716048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:47.716667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.718415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.736724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2bda-f886-4ffa-837a-b3794b7ec75d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.738545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 329/658] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:47.739712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.774635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.775590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.775883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.776166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.784112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.786009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:47.798535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:47.799550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 12:38:47.800524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:47.804939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 330/659] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:47.805908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.855608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45532d-4ac3-4fc7-a106-eb9257640e56 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.878055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:47.896452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.898067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.898576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.899154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.900182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:47.900754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:47.902363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:47.915677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173d2e3-9ed4-47b4-86a3-573fb5b1c72b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:47.915998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 330/660] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:47.917127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:47.953110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:47.953740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:47.954080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:47.954351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:47.962676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.029637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c4dd-ac58-4f94-b3a8-3cfbdf091ec5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.030538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.032413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a7300-dc18-4e16-9194-abc6087bbbd0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.068212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.068829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.069154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.069529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.070361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:48.070668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.072091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.089862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 331/661] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:48.090335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.111244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 331/662] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52614d-690c-42fc-b8a8-6c372141721e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52614d-690c-42fc-b8a8-6c372141721e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52614d-690c-42fc-b8a8-6c372141721e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 332/663] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:48.155828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52614d-690c-42fc-b8a8-6c372141721e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.200716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.208202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130aeeb-49e5-4402-8888-8472c040a847 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.246808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.247447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.247729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.248007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.255403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.257584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.261839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52614d-690c-42fc-b8a8-6c372141721e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:48.270414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:48.271365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:48.272401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 332/664] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:48.273473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.304602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.305148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.305454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.305728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.342198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.380573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e4ff-9d7f-4031-a9d2-ff6781fda60b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.381783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.383430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.416733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.417376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.417661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.417976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.429093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.430559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-312d338f-0bee-4489-8503-48c9b9886240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:48.445883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:48.446827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:48.447754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:48.447754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:48.447754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:48.447754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:48.447754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 333/665] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:48.448750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.448750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.448750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.467511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:48.468696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:48.470806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.495940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 333/666] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:48.496812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.545381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 334/667] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:48.546329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.568370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.605294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ca284-6804-4ac0-8e82-4bce3f80e6e2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.639944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.640592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.640835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.641117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.641902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:48.642215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.643661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.659303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 334/668] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:48.659303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.659518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8112-29cb-4c78-9b72-c75e49ba0622 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.692665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.693283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.693568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.693869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.695151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:48.695452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.696810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.703217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.708709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 335/669] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:48.709488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.765149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b708-b79c-4aad-89db-ff160601902e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.790053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.798959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.799603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.799889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.800165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.809406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89233d75-55f1-498f-8da8-dfa323c9542d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.810552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.811985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-26f6554e-a2ab-452e-8fbb-7b9619b47bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:48.826358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:48.827351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:48.828254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:48.828254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:48.828254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:48.828254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:48.828254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 335/670] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:48.828990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d756-d9a4-4494-b5ef-5c11c506b0ac None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.828990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d756-d9a4-4494-b5ef-5c11c506b0ac None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.829200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d756-d9a4-4494-b5ef-5c11c506b0ac None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.830397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 336/671] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:48.831088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490d756-d9a4-4494-b5ef-5c11c506b0ac None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.846824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.847466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.848044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.848044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.858606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:48.864001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:48.865092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:48.866854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 336/672] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:48.868591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:48.924629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:48.935989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490d756-d9a4-4494-b5ef-5c11c506b0ac None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.967626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b2c0-ae70-4a46-a579-8b9f2ee64df2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:48.970704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:48.971312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:48.971594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:48.971866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:48.972646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:48.972955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:48.974405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:48.980359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 337/673] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:48.981133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.003403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.004064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.004346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.004621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.013022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.014517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fd80447b-aa1c-4615-82ac-39cb40fd99d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:49.027704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:49.028712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:49.029646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 337/674] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:49.030751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.030751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.030751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.036737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.054960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:49.056191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:49.103153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1a691-2675-4139-b4fe-238b4f8f061a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.130436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 338/675] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:49.131361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.141450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.142359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.142817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.143242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.144085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.144538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.146106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.163177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 338/676] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.164205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.199414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.271146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a421-4898-43bc-8403-83f9c22c8d30 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.284788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e111d5-d5a8-4d09-a718-042ed08a475d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.286332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.314232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.314857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.315141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.315420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.316143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.316452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.317821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.323101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.324153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.324440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.324869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.325630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.325980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.327142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 339/677] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.327396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.328256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.349037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 339/678] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.349037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.440256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d85bc-b4c7-4fc0-b796-317f6c95248f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.450415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af424-100a-4a62-8b0a-2a009b1fea02 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.451810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.478549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.479285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.479574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.479850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.485490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.486154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.486438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.486712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.492104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.493669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.498288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.499788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:49.508910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:49.510089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 340/679] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:49.516090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:49.516446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:49.517247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 340/680] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:49.518173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.546665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.625241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ff1f-f56c-4f76-b52b-4a8df1f6956e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.627571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f262-0e29-49a0-8f3a-44d788684b22 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.660423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.661029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.661346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.661627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.661943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.662557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.662888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.663260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.664055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=2135e982052e41cc834c5c0a6608decc) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.664378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.665837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.681980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 341/681] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/role_assignments?user.id=2135e982052e41cc834c5c0a6608decc&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.681980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.685654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.687200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:49.705932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:49.706917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:49.707917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:49.707917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:49.707917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:49.707917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:49.712551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 341/682] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:49.713392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.754242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.805970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:49.827461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25519-fed1-4344-976a-c169ab9eb184 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.838101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e989-2668-4e07-826e-71ed1cd81b36 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:49.868175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.868859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.869141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.869419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.870309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.870713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.872086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.880991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:49.882310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:49.882597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:49.882878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:49.883631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:49.883939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:49.885449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 342/683] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.885560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:49.888110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.900683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 342/684] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:49.901499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:49.987093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:50.009107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f60d4-c28f-43c1-b0e1-70e2b6538dec None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.015936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08328fe1-d12e-4d40-a04e-90c6d9ae9847 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.055551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca376-0587-4930-9eff-265450d1642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.056627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca376-0587-4930-9eff-265450d1642d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.057107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca376-0587-4930-9eff-265450d1642d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.057584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca376-0587-4930-9eff-265450d1642d None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.058438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.058779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca376-0587-4930-9eff-265450d1642d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:50.059248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.059422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca376-0587-4930-9eff-265450d1642d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.059715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.060104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.060881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.061415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca376-0587-4930-9eff-265450d1642d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.062503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.075400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 343/685] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:50.076831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca376-0587-4930-9eff-265450d1642d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:50.087648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:50.093500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 343/686] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:38:49 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:50.094717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:50.199534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca376-0587-4930-9eff-265450d1642d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.243049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.243794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.244230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.244615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.245841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=d12b699d6f6c4047a4b414e0ccff2e6e) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:50.246708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.248598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.249492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6317-e436-4efc-8481-e20f8074dfef None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.266761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 344/687] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:50 2022] GET /identity/v3/role_assignments?user.id=d12b699d6f6c4047a4b414e0ccff2e6e&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:50.291153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:50.294797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.295464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.295746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.296025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.307199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.308789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:50.328455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:50.329500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:50.330505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 344/688] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:50.335660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:50.421148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:50.458412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a91cc-7cb0-4259-af64-8228c296a9c7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.502877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.503853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.504344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.504828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.505871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:50.506410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.508651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.533601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 345/689] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:38:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:50.541653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:50.706095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd1ba-4884-4adc-b111-4156bb769c5e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:50.757018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:50.757533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:50.757837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:50.758096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:50.840000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:50.851491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:50.852950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:50.968630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 345/690] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:50.973915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.110929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3735a-efaf-4e49-9437-9acca0e7e237 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:51.151324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:51.159903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:51.160542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.160821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.161094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.181724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:51.183209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-46f3ebe9-a203-4385-b016-4d110f21d95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:51.203331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:51.204284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:51.205186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:51.205186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:51.205186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:51.205186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:51.205186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 346/691] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:51.211784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.248244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aeb9d-c49a-48d2-b4eb-73481b3ddbed None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.248553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aeb9d-c49a-48d2-b4eb-73481b3ddbed None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.248817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aeb9d-c49a-48d2-b4eb-73481b3ddbed None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.250459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 347/692] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:51.255150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.255440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.255725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.274408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:51.275609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:51.339439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:51.350812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010fb1e-1d62-4a85-8aed-2d63d8363950 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:51.391186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:51.392064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.392351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.392631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.393735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:51.394072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:51.395452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:51.409190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 346/693] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:51.414714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.437865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 348/694] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:51.467717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.602038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01983c86-e705-41ac-a752-e225ec96f82c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:51.636098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491b3b5-2511-440a-99b5-83e9afd5dab0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:51.648629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:51.674899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:51.675638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.675991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.676339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.680071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:51.680721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.681007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.681284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.688322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:51.693797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:51.694889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:51.695764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 349/695] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:51.701134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:51.701458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.702748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:51.725059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:51.727769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:51.729932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:51.734289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 347/696] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:51.739511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.766195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:51.815985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90a67-86af-4d1e-a6ae-92b9071a6ff3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:51.861911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:51.862462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:51.862746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:51.863028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:51.863757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:51.864067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:51.865451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:51.886470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 350/697] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:51.891768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:51.930799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.004651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b36c-0e5b-4c15-9e50-520ed8187ac1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.011749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a609a8-41af-46b6-9f18-1363241a86dc None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.044887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.046075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.046469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.046847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.064481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.066128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.068062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.068964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.069458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.069933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.070828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:52.071282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.072811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-ac393af4-65c7-410f-b0ba-e28c6559c685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:52.083298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:52.084222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:52.085716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:52.085716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:52.085716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:52.085716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:52.089943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 351/698] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:52.091186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b633d-1b55-40cf-bcc9-c0235d4a03f7 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.091476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b633d-1b55-40cf-bcc9-c0235d4a03f7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.091756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b633d-1b55-40cf-bcc9-c0235d4a03f7 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.100532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 352/700] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:52.100532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b633d-1b55-40cf-bcc9-c0235d4a03f7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.101415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 348/700] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:52.102605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.177524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.201899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.222676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b633d-1b55-40cf-bcc9-c0235d4a03f7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.223800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baee68-b4c0-4e6f-9efa-e19b1f713575 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.269355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.270010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.270298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.270579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.271381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=182ee307b1394f72bc71477eb027da49) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:52.271692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.273377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aa4cc-b1da-4632-b123-a0522ad5f4b6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.273920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.274766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.275246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.275717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.276670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:52.277218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.278929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.279862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 349/701] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/role_assignments?user.id=182ee307b1394f72bc71477eb027da49&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:52.281055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.281345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.281628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.296080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 353/702] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:52.301773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.302035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:52.303179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:52.379985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 350/703] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:52.418607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.434796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5a58-197f-486e-a308-9046c200a585 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.472753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.473839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.474296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.474787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.483703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.485443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:52.499337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:52.500343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:52.501396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:52.504014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 354/704] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:52.509905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.514858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.548579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.602535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f8edc-230e-4a36-9e78-204128f66f20 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.616605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59670-5f7e-4d70-a062-a5a84ca561aa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.646030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.646685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.646970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.647321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.648266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.649737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.654285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.655196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.655684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.656166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.657170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:52.657691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.659335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:52.663521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:52.664555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:52.665411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 351/705] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:52.670319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.682971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 355/706] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:52.688685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.760082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.784193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bd4-4d86-4c90-b46d-851225dc0b4a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.796003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dae94-bd84-4b49-87e7-142ec801aba4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.814398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:52.822362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.822990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.823283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.823572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.824234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:52.824540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.826096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377feab-1e90-4748-9361-903f2b94f73a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.831515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 352/707] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:52.835632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882ac0-c0ad-404e-9624-6238c248ee8e None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.836138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882ac0-c0ad-404e-9624-6238c248ee8e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.836652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882ac0-c0ad-404e-9624-6238c248ee8e None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.839775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:52.840652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:52.841136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:52.841641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:52.843734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 353/708] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:52.844704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882ac0-c0ad-404e-9624-6238c248ee8e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:52.917054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:52.918969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:52.960444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882ac0-c0ad-404e-9624-6238c248ee8e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:52.982294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.001207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.001854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.002147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.002427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.003223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:53.003460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.004836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0e99-9d9e-4100-a478-7172ca7b30d0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.018134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 354/709] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:53.019641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3503-53f3-41b1-9d52-617df791d363 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.020059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3503-53f3-41b1-9d52-617df791d363 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.020324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3503-53f3-41b1-9d52-617df791d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.035393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 356/710] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 12:38:53.047321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.055236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ba4c3503-53f3-41b1-9d52-617df791d363 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:53.056465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ba4c3503-53f3-41b1-9d52-617df791d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:53.120044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.149987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 355/711] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:53.151928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c789c-bee5-4ca6-9594-9c4fbdba104c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.152378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c789c-bee5-4ca6-9594-9c4fbdba104c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.152811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c789c-bee5-4ca6-9594-9c4fbdba104c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.154658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 356/712] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:53.159644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.160094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.160525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.162215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c4d1-4afe-4eb8-bf17-59c90e10605c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.191780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:53.193277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:53.201063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.201907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.202264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.202617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.214052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.215601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:53.232569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:53.233525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:53.234484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:53.234484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:53.234484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:53.234484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.234484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 357/713] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:53.234904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.261744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.278283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 357/714] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 12:38:53.279466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.372572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b89a9-ddd5-4ace-a8db-f1dd132dec80 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.407960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.408495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.408783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.409064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] PATH_INFO: `/v3/services/network` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.409703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.411129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:53.423990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:53.425144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.426036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 358/715] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:53.430405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.438048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a9cb2-f218-48c7-a779-2ae7fc9ccef4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.456707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.476937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.477484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.477769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.478075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.478775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:53.479080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.480457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.496251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 358/716] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:53.497551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.529339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.560149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239cab-c4fa-429e-8d8a-b672c527cd1d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.608821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.609992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.610837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.611399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.617313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae500ae-3ec0-430b-9fd2-8fa25c86ebf3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.626115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:53.633563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:53.634781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:53.635857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.643908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 359/717] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:53.643908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.664879 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.665863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.666807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.667301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.668488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] RBAC: Adding query filter params (name=network) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:53.669176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.671434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.677932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 359/718] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:53.679563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.736888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.757839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c8d07-dd68-4fd6-98c7-8230efdee05f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.813293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660050-cd04-48da-97a7-f3b9a51116ad None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.853391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.854365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.854863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.855331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.856254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:53.856747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.858409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.873424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 360/719] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:53.874708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.916991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:53.917965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:53.918502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:53.918976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:53.927030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:53.929443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:53.931309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:53.943333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:53.944363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:53.945284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:53.947899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 360/720] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:53.948931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:53.981593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e84d-1853-4c2a-a35c-88b9de2abbed None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:53.983238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.018097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.018583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.019117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.019211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.020018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] RBAC: Adding query filter params (type=network) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:54.020340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.021844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.034139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 361/721] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:54.035316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.062733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5559745-3b98-4848-8841-8c1be4d6f9bc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.102337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.103331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.103814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.104299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.116141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.117989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:54.135373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:54.136411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:54.137369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:54.137369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:54.137369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:54.137369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:54.139729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 361/722] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:54.145512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.202583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.260819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc2f4-3522-4940-8a84-5bbc0939256e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.269079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8da0b5-a882-4dbe-98a7-b93e71fb5ff9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.297960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.298978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.299470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.299974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.300901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:54.301415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.303105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.321168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 362/723] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:54.322464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.344047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.344780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.345070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.345347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.346142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:54.346507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.349014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.363612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 362/724] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:54.370659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.405005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.432973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdef5c-f739-426a-b31f-e0b41a835034 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.444949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.470153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.470946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.471336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.471772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.479670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.481216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:54.495538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:54.496744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:38:54.497951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:54.499769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 363/725] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:54.505188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.531087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe148d0-7e77-4529-a08a-3596d4d73066 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.602077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.603000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.603457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.603872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.604930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:54.605387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.607165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.613849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde11dc-e11b-4da4-9670-2da03351a57a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.619604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 363/726] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:54.650009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.650651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.650934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.651219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.652046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:54.652358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:54.653868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b976c9-2eba-430e-b6b6-7601ab7b7967 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:54.673436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 364/727] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:54.679593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:54.855830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78778-048c-4957-8314-6cf1e809a2cc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.856114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78778-048c-4957-8314-6cf1e809a2cc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.856389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78778-048c-4957-8314-6cf1e809a2cc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.857763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 365/728] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:54.863457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.864030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.864510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:54.900407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:54.901973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:54.937386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.944474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e6b3-8739-4f81-babf-d4b43431ff42 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:54.949832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:54.993598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:54.994249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:54.994527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:54.994793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.051896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 366/729] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:55.070196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.071639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.090397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.174837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.181265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 364/730] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 12:38:55.188118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.301527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe83d53-d23b-4e90-bae9-6d0ebed1c5a0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.333651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa86f-f8d1-45e9-8710-f419fae9ea12 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.341335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.342479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.342988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.343586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.355427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a331862e-0ace-4891-a9bd-ca5527dcb186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:55.360282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:55.361221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:55.362114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 367/731] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:55.363302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde836c-257d-4125-b90f-9b4da47e2125 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.363302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde836c-257d-4125-b90f-9b4da47e2125 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.363608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde836c-257d-4125-b90f-9b4da47e2125 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.369087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 368/732] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:55.370491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde836c-257d-4125-b90f-9b4da47e2125 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.377072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.377716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.378024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.378299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.389602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.391195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.395878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-b081bf88-a09f-4a0d-9871-ba9082b6e7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:55.408675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:55.409621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:55.410587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:55.410587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:55.410587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:55.410587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:55.413955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 365/733] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:55.415263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.415555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.415840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.436107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:55.437216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:55.473840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.496522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde836c-257d-4125-b90f-9b4da47e2125 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.510565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 366/734] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:55.511395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.535586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.536554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.537110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.537755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.538710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:55.539303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.541098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.551156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 369/735] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:55.556601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.620618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20694f7-7ffa-44c6-9dee-44129fac2cbe None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.647806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.659182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.659901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.660190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.660468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.661422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:55.661603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.663522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.671492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ee9-7f03-481f-8d8e-678536c9d271 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.675872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 367/736] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:55.676518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.709135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.710218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.711448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.711979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.712528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.713548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.715164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.734380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 370/737] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:38:55 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:38:55.735655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.790898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c517b-ecba-4881-9548-e16726bcd190 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.863368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bac00-4cdf-4d95-a447-c6a399b09fb0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:55.874542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.875210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.875491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.875804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.893985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.895863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.904965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:55.905952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:55.906418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:55.906876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:55.909915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:55.913749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:55.922960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:55.923868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:55.923868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:55.923868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:55.923868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:55.924093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:55.924093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:55.926778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 368/738] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:55.933982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:55.935075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:55.936199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:55.937958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:55.938953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 371/739] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:55.946495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.056368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:56.063775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9efe3-b742-4c81-b710-748e0acd5ebf None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.078124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007485e7-39e3-4878-8b93-12eb71093fe6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.103265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.104071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.104458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.104836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.105704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:56.106777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.108460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.123905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 372/740] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:56.127391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.128195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.128619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.129036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.129939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:56.130288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.130625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.134254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.150330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 369/741] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:56.158871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.209167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:56.265862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d5d2-1d60-4b94-9b63-7858450bda6f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.301024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.301665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.302040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.302389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.302583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bb90b-9e95-4936-969b-b06b96e4ea20 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.303377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=71beef48ee884f8fafc75df6766d1064) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:56.304265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.305953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.312797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 373/742] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:56 2022] GET /identity/v3/role_assignments?user.id=71beef48ee884f8fafc75df6766d1064&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:56.342302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.343289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.343797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.344251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.353950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.355732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:56.370205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:56.371291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:38:56.372253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:56.374693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 370/743] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:56.381886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.506862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52214319-8052-433a-b85c-71ea93d11920 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.528566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:56.544327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.545126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.545424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.545709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.546561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:56.547246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.548701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db5b2-36c7-48fa-be4a-01cc12131648 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.568355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 374/744] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:38:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:56.574586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.583684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:56.670058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4709de-014d-489f-80c8-6b28d49b30d7 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.670395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4709de-014d-489f-80c8-6b28d49b30d7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.670627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4709de-014d-489f-80c8-6b28d49b30d7 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.672265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 375/745] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:56.677563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.677875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.678154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.707294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:56.708773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:56.789377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d961-92e7-4c70-8803-02de0906eec4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:56.827662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:56.828282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:56.828561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:56.828835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:56.866901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 376/746] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 12:38:56.901951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:56.938870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:56.940707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:56.950789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.077653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43d3a-127e-4357-89a4-cd5c5384a0f8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.091528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.120828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.121465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.121731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.122016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.122707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:57.124800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48380075-22f2-45eb-8e6e-c77a9b7a34e0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:57.138870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 371/747] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:38:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 12:38:57.142487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 377/748] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:38:56 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:38:57.144511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.252325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40abcf-1fcf-4f99-9470-2c1949aa1b0e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.253148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40abcf-1fcf-4f99-9470-2c1949aa1b0e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.254163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40abcf-1fcf-4f99-9470-2c1949aa1b0e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.256550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 378/749] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:38:57.262451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.263794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.264303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.296747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:57.298453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:57.315644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbab2-f6e4-4706-956e-119b80397262 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.319062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.400314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.400880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.401163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.401440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.405333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 379/750] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:38:57.416489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:57.417974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:57.433345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:57.434343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:57.435802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:57.435802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:57.435802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:57.435802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:57.435802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 372/751] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:57.438403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.439673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.552769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec644-549b-4e98-8fb0-f88d6a38559d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.558726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.568035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e35a-ef83-4d58-bcbb-174893cbed57 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.605256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.606415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.607177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.607929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.608926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:57.610928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:57.611657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:57.615456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.617148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.617654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.618175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.629522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:57.632906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 373/752] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:57.635848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:57.636773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:38:57.637638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:57.638776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.640608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 380/753] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:57.646053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.660953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.754061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044d289-c285-4242-a1b8-e1603bc8cdbc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.791483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.792593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.793078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.793577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.794528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:57.795037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:57.796664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:57.806221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 381/754] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:57.811265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:57.858240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:57.923131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef460e8-ba53-4447-8d70-ed37de9e6452 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.960903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:57.961936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:57.962423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:57.962924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:57.974510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:57.976963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:57.977078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecbc90-9ce8-4a27-9c2b-1d833c024836 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:57.993298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:57.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:57.995234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:57.995234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:57.995234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:57.995234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:57.997386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 382/755] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:58.006967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.046588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.046588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.046588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.046588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.057839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.059316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:58.076743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:58.077694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:58.078714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 374/756] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:38:58.083803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.138294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.160665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a7af-6e94-4cb7-8222-7b371ec8daea None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.198142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.198683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.198965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.199238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.199932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:58.200235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.201597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.226715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.228002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 383/757] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:58.233744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.290183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c3dc8-e65b-457e-bdd3-0848c58c173b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.374626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83fc7-f70a-44e3-9bf6-588dd2b575e3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.391116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.391757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.392036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.392310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.393070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:58.393373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.394822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.402224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.416763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.417414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.417694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.417997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.422775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 375/758] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:58.428107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.433305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.434790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:38:58.453842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:58.454817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:58.455779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 384/759] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:58.463280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.556752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1708-d9b2-4b9f-a4d8-e9cbe4cea972 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.590423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.595923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.596934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.597296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.597643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.598524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=182ee307b1394f72bc71477eb027da49) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:58.598899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.601340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680b8ee-844f-466d-821e-6cf56716375d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.608263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 376/760] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/role_assignments?user.id=182ee307b1394f72bc71477eb027da49&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:38:58.609480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c229-4e15-4889-bcaa-ce3e1afec44d None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.609769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c229-4e15-4889-bcaa-ce3e1afec44d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.610175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c229-4e15-4889-bcaa-ce3e1afec44d None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.611892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 377/761] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:58.618787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.619150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.619492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.639095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:58.640385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:58.655174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542195-4b61-4bcb-9cd2-8ae2820c4c59 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.704986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.707600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.709741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.710236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.711241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:58.712896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.714559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.752188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 378/762] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:38:58.757151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 385/763] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:58.762596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.775100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.833075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.894027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28176a1-fdc7-4854-afa6-77b4a1611841 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.904131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f2d75-44ee-4c53-9099-763be72b96e1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:58.923318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:58.934164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.934799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.935183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.935560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.946971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.948417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.953272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:58.954211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.954697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.955247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.956441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:58.958680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2eb8cd43-5300-456f-8d2c-a6dca1841998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:58.964782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:58.965692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:58.966749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:58.966749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:58.966749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:58.966749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:58.966749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 379/764] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:58.968233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844d3-f0f1-448c-8773-ab5eb8c1e4b9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.968627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844d3-f0f1-448c-8773-ab5eb8c1e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.968974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca844d3-f0f1-448c-8773-ab5eb8c1e4b9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-803ae3d9-0ddb-45fb-a122-943bf8234778 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:58.971765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:58.972701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:38:58.973589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:58.974861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 380/765] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:58.975947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca844d3-f0f1-448c-8773-ab5eb8c1e4b9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:58.977348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 386/766] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:58.979006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:58.979521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:58.980899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.004008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:38:59.006032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:38:59.088125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca844d3-f0f1-448c-8773-ab5eb8c1e4b9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.096338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 387/767] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:38:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:38:59.097198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.145602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.150241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.151197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.151492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.151775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.152643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.152953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.155103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.171448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 381/768] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.172680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.218349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97af49-9fdb-45d6-9599-df85f8433d92 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.221233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.264713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.265764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.266142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.266621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.267511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.267903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.269506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.276234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 388/769] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.277563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.293545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9daf9-4488-4594-aed4-e6e0b28d7b2e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.331125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.332150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.332614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.333098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.345198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:38:59.351494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:59.352437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:38:59.353321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:59.360790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 382/770] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:59.361934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.402244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88fca2-fda0-4554-98bc-dc553b086b0c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.404647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.441539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.442673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.443299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.443848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.451708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.453574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:38:59.466306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:59.467265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:38:59.468204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:38:59.470976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 389/771] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:59.471965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.478174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.482313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188baba-74e7-42fe-ba6f-9a84bf714612 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.526335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.527359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.527892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.528370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.529254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.529779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.531424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.536991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 383/772] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.538532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.603228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e77a6-9b47-48b2-98d7-c48d91a8ad29 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.644681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ac98-a67a-4e40-a6c9-3c3a201788f7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.649852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.650490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.650788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.651053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.651776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.652085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.653454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.669569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 390/773] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.669569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.692957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.693583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.693945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.694230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.695331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.695650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.697770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.699341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.717072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 384/774] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.718348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.745245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.784520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08817691-2bf2-4e4a-b34d-3c1b0578d7c6 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.823185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.823825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.824111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.824388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.825156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] RBAC: Adding query filter params (interface=public, service_id=cd6efa93e237403aa61d9067aeee1e58, region_id=RegionOne) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:38:59.825475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.826883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1706dd-abbc-4843-a6c0-c3f7966f91e2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.828718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfae9d-606c-438a-99b7-7f99e27abb8f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.835449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 391/775] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/endpoints?service_id=cd6efa93e237403aa61d9067aeee1e58&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:38:59.836906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ec2c-bebc-4adc-98bc-0afab2f85691 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.837193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ec2c-bebc-4adc-98bc-0afab2f85691 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.837475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ec2c-bebc-4adc-98bc-0afab2f85691 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.838874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 392/776] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:38:59.839390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1ec2c-bebc-4adc-98bc-0afab2f85691 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.872484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.873211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.873499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.873774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.885539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.887105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:38:59.903357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:38:59.904272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 385/777] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:38:59.905232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:38:59.944015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.955358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1ec2c-bebc-4adc-98bc-0afab2f85691 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:38:59.985717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:38:59.993355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:38:59.994062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:38:59.994346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:38:59.994630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:38:59.996676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=b9dd08e0da964403bf7d7e2b34669efb, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:38:59.998121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fe9e3-2b5a-4e5a-a31c-864a3b06f339 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.012841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 393/778] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:38:59 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:39:00.014038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.014335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.014643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.029296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a386f-6417-472d-803d-245dd24d0003 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.046625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:00.048372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:00.073425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.074169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.074454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.074786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.075524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.077225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.084346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 386/779] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:38:59 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:00.087466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.192780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 394/780] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:00.218997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.285299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2569-b417-4702-8fd7-7d666c2c8144 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.331137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.332167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.332579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.333009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.333712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:00.334043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.335139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:00.338528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.351102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:00.360168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 387/781] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:00.363995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56a8b-cd3e-412d-bbb8-77c9534e758e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.367142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.409431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.410125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.410415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.410698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] PATH_INFO: `/v3/services/network` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.411424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.412901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:00.423648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:00.424697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:00.425555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 395/782] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:00.433102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.497489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb3dc4-8107-4743-a40e-096b9e7a9411 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.536060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.536625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.536907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.537183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.541311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a2be7-dff7-4f06-8ba5-a5b37a70de03 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.545973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.547420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:00.561420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:00.563684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:00.566042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 388/783] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:00.573883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.583986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.585169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.585458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.585739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.586453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] RBAC: Adding query filter params (name=network) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:00.586760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.589144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.597957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 396/784] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:00.606067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.621522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:00.673164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:00.754260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c141-8cc9-41bc-91c0-232a2beedcc0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.763434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c682-3933-4cdb-8aea-712a7e7e1bdb None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.792192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.792726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.793004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.793274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.794089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:00.794394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.795806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.804967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:00.806404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.806687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.806963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.807648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] RBAC: Adding query filter params (type=network) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:00.807955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:00.809313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f07fd-ad08-424c-a6bc-006529aba039 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:00.816003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 397/785] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:00.820668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d89b-bbdd-4ca4-bfd1-44751648e222 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.820668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d89b-bbdd-4ca4-bfd1-44751648e222 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.820668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d89b-bbdd-4ca4-bfd1-44751648e222 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.823935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 398/786] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:00.824721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 389/787] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:00.829003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:00.829003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:00.829003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:00.831237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.846706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:00.848143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:00.929947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 399/788] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:00.930891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:00.933574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:00.965161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3134-939a-4fad-9d0b-8341e4361131 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:00.988131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.014815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.016002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.016388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.017034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.030542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.033786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:01.052091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:01.053230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:01.054574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:01.054574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:01.054574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:01.054574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:01.060223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 390/789] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:01.060223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.072877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ddba-0f21-44e4-a5c8-aceb46da4892 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.125459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.126774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.127508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.127944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.128871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] RBAC: Adding query filter params (interface=public, service_id=da73fb737c854c8dae6e48544cd3b1c8, region_id=RegionOne) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:01.129338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.132030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.143765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 400/790] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:00 2022] GET /identity/v3/endpoints?service_id=da73fb737c854c8dae6e48544cd3b1c8&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:01.143765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.171156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba124c6-fa58-46ff-a3cc-ee1781553e14 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.218597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.220167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.220642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.221100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.222835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.238713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:01.246759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:01.247733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:01.248604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:01.251575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 391/791] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:01.252518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.273584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bbd85-d82f-4043-868d-4ac6e7d38c4d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.290927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.322028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.322939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.323376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.323807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.325488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:01.326044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.328005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.347172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 401/792] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:01.348041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.384781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f1c34-40cb-4a5e-bb08-03e0bc3c9281 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.433524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.434555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.435054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.435533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.436389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.438511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.446982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 392/793] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:01.448000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.492454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7e89-a703-474d-975f-0075ffeef134 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.565185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.571342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.579527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7d1e-ef88-4cc8-9c7c-379baf111163 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.582759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.583679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.584167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.585205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.586290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:01.586825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.588407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.597766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 402/794] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:01.604048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.622841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.623511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.623794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.624071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.634738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.636364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:01.655646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:01.656642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:01.657579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 393/795] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:01.662898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.737221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cecc2-d42f-45b0-af8f-7eeff01e7dea None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.774273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.774960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.775242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.775566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.787413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.788899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.793981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71785f-c443-4236-a144-ef87b19fa7ae None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:01.814449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:01.816551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:01.818815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:01.818815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:01.818815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:01.818815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:01.823764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 403/796] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:01.824827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.831385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:01.831952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:01.832234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:01.832511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:01.834214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:01.835064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:01.836494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:01.850624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 394/797] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:01.856236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:01.873397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.944459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:01.972235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb8853-fa57-48b0-a180-343c0e8bbc48 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.012069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.013045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.013507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.014295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/71beef48ee884f8fafc75df6766d1064/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.046264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=71beef48ee884f8fafc75df6766d1064, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:02.048573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:02.066302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 395/798] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:01 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/71beef48ee884f8fafc75df6766d1064/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:39:02.104453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed271-de68-4e32-a641-a3b6aa5cebb3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.148948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.149608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.149915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.150194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.150927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:02.151238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:02.152779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6561c62-0ae5-40e3-9e90-bd097f658359 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:02.173512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 404/799] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:02.179878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:02.283640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:02.340432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363145c-3df0-43e2-a09a-4a13d05d318e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.398614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.400041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.400532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.401051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.408324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec3cf-213d-4d42-8096-00e96ee9c94c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.408808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec3cf-213d-4d42-8096-00e96ee9c94c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.408911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec3cf-213d-4d42-8096-00e96ee9c94c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.410193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:02.410327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 405/800] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:02.411969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:02.418815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.419102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.419381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:02.430965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:02.431935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:39:02.432917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:02.435539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 396/801] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:02.441232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:02.458766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:02.461835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:02.566056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 406/802] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:02.618521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c680422-a7fa-453d-882d-1a9c8dc4eb50 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.641708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:02.656912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:02.680919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.682947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.683635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.685160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.686447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:02.687781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:02.690090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb93ea-321b-48ee-909f-c3a51ad38a2c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:02.697306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:02.715118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 397/803] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:02.720514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367cf5-eb9d-47a3-a9b3-243a367763b1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.720514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367cf5-eb9d-47a3-a9b3-243a367763b1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.720514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367cf5-eb9d-47a3-a9b3-243a367763b1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.720514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 398/804] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:02.723122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367cf5-eb9d-47a3-a9b3-243a367763b1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:02.795909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7630e-1431-4648-a66d-45724d8c0ca3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.839973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.840975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.841493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.842157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.843450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367cf5-eb9d-47a3-a9b3-243a367763b1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:02.853762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-7a2a47a9-0e82-4f66-bf35-b3bc5ea9da30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:02.859703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:02.860649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:02.861520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:02.864239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 407/805] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:02.866307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.866874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.867356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.883608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:02.884295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:02.884577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:02.884848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:02.887071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:02.888516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:02.897826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:02.899269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:02.920652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:02.921580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:02.922818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:02.922818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:02.922818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:02.922818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:02.925958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 399/806] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:02.927837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:02.968282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:02.981836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 408/807] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:02.983491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.014006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.052460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd571241-3ce2-419a-a816-5ea6c5f80ca5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.088896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.089682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.090098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.090474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.091293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.091703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.093168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.102844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 400/808] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.103807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.118166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e61e81-de4a-4d39-a36d-e41c5de45cb1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.168195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.168820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.169102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.169628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.170811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.171075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.172976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.189908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 409/809] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.190833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.211957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.220396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c2b4-f1d5-4c26-8d57-db6395e6c421 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.258342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.258987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.259371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.259657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.261770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:03.271781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:03.272923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:03.273840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 401/810] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:03.274706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.300454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.326529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae1e6-64f7-4f00-b863-0fde650cf4ac None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.373927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.374584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.374868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.375146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.388434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.390066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.405055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da63-cec4-44b7-aa97-fcccdaeea41c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:03.407218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:03.408141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:03.409446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:03.409446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:03.409446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:03.409446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:03.409446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 410/811] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:03.409741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.449662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.450271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.450549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.450823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.459692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.462382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:03.478389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:03.479362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:03.480284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:03.481880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 402/812] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:03.482838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.508567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.533282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c6d8c-0772-4ef9-852c-fc3ae74ca6ba None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.565750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.572830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.573589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.573900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.574228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.574961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.575274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.576735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.587001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 411/813] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.587001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.602313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef97a-4f60-48dc-9ffd-3cc89017c0a2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.638134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.639068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.639531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.639985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.640850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.641333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.642902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.656307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 403/814] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.657368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.696986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400f5a-c577-410e-babe-306d9958568a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.735726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.736283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.736563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.736836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.737594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.737930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.739488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.743569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.755323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 412/815] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.756952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.767828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda791-f091-4714-bcdd-c1254e16a916 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.803315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.803982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.804240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.804620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.805294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:03.805607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.807009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785026b-7b48-4d48-81f5-0710b249d74b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.813974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 404/816] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:03.815368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682f152-387d-41c7-880b-2661f23d3d0b None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.815729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682f152-387d-41c7-880b-2661f23d3d0b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.816082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682f152-387d-41c7-880b-2661f23d3d0b None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.821523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:03.822034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 405/817] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:03.822847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682f152-387d-41c7-880b-2661f23d3d0b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.872383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d7b3-e974-4746-a4e5-6e65034a45a8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.909588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.910522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.910956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.911379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.918750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.920357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.926377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682f152-387d-41c7-880b-2661f23d3d0b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:03.932688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:03.933871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:03.935049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:03.941388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 413/818] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:39:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:03.942393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:03.964295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:03.964961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.965238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.965515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/182ee307b1394f72bc71477eb027da49/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.967483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=182ee307b1394f72bc71477eb027da49, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:03.968905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870422-2297-441b-bcf8-6eb324ce862e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:03.982862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 406/819] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:03 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/182ee307b1394f72bc71477eb027da49/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:39:03.984064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:03.984348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:03.984623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:03.991910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.006856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:04.008151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:04.088443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920fa5-5fd9-4bf0-adf4-97c0f1e31922 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.106910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.110751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 407/820] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:04.112248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.157939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.158586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.158871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.159153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.159878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:04.161250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:04.191949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 414/821] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:04.192808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.268170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49e9b-9533-4bc9-ad4a-6276dcecc876 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.334088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.346859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.347657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.348038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.348414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.349307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:04.349682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:04.351467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767e01b-b01f-40c9-a19f-68f745138033 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:04.371536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 408/822] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:04.372928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e512-3970-4437-9d45-c47a9cc300e5 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.377176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c83c0-92a4-4cff-846c-2d2de054a726 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.377769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e512-3970-4437-9d45-c47a9cc300e5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.378201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e512-3970-4437-9d45-c47a9cc300e5 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.383817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 409/823] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:04.383817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e512-3970-4437-9d45-c47a9cc300e5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.433349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.434072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.434368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.434650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] PATH_INFO: `/v3/services/network` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.435351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:04.436758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-6643a81c-11a0-4b9b-8cb2-79a965a893fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:04.446515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:04.447564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:04.448456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 415/824] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:04.449270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.449270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.449553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.473151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:04.474476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:04.511367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.517834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e512-3970-4437-9d45-c47a9cc300e5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.555561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.556280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.556660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.557030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.566017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 416/825] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:04.566874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.637318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.652270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:04.653865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:04.693086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c0ce-a6df-495d-bea6-d32f0ac3f177 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.732221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.732867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.733415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.733701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.734675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] RBAC: Adding query filter params (name=network) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:04.734994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:04.737127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:04.744977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 417/826] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:04.745836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.778671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.797569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 410/827] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:04.799471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.918899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff038d-da99-42ee-abb3-27007ad36ad3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.941163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:04.957236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914babd2-8b73-4afc-b521-e585cdee67e3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:04.959447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.960330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:04.960843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:04.961322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:04.972695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:04.978693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:04.979659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:39:04.980527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:04.983103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 418/828] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:04.984094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:04.999279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:04.999894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.000172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.000443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.001125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] RBAC: Adding query filter params (type=network) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:05.001422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.003115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.012814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 411/829] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:05.013763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.085515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.101370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49111a0-7dec-420b-b5f7-1d092f3e5299 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.137927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e0f66-19bd-49c7-8463-a147a1485701 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.150339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.150991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.151274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.151553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.164948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.167163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.182207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.183098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.183579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.184054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:05.184736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:05.185602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:05.186623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:05.186623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:05.186623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:05.186623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:05.186623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 419/830] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:05.187309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.187763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:05.188281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.190073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.201331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 412/831] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:05.202467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.221441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.311472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6a44-36cb-4223-8686-9023023024d8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.315855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e960b7-d632-4dde-9500-590c7039225b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.349461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.351160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.351763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.352283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.353192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.354899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.359342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.359954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.360239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.360522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.361200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:05.361500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.362875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.372768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.376542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 413/832] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:05.377513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.383294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 420/833] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:05.384459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.486583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.516892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f547f3-6929-43f4-ab2e-6da2541174cd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.569347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.570913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.571398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.571876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.585134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.587185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:05.605505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:05.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:05.607392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:05.607392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:05.607392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:05.607392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:05.610325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 414/834] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:05.619762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.658168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5edd-b451-4b4e-9bf3-ee0d3b0c4bb8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.700095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.701228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.701738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.702354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.714921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.717119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:05.733537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:05.734650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:05.735578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:05.738232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 421/835] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:05.743887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.746076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc0f5-de38-4dab-8958-9d469a3ef304 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.778185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.786737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.788112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.789281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.790622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.791471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:05.791863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.793413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.814391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 415/836] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:05.820426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.826885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:05.882704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841fb39-46ae-430d-a155-914929bb7d65 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.931732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.932466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.932811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.933153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:05.934050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:05.934423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:05.935970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:05.942344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ed143-ad30-4114-9ef7-65806b2fe6ff None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:05.953413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 422/837] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:05.959245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:05.986867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:05.988815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:05.990182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:05.990463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.000236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.002290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:06.017461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:06.018528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:06.019520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 416/838] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:06.032407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.088368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.109716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7a3b-6654-4fca-bb19-6fc77b20cb91 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.129052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.149988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.150652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.150934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.151209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.152112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:06.152414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.153974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fdf98-de73-4151-aaef-a62689c4c491 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.157398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572532a-2653-4b1c-804f-81257bc580d3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.160663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 423/839] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:05 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:06.192475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b8d6-4cad-4167-bcbe-cda87d425fe1 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.192796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b8d6-4cad-4167-bcbe-cda87d425fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.193031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b8d6-4cad-4167-bcbe-cda87d425fe1 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.194941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 424/840] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:06.199755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.200515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.200800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.201077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.201473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.201989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.202479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.203548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:06.204088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.206078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.221361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:06.222619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:06.228979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 417/841] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:06.234419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.319688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 425/842] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:06.341928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.369226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.374445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe9d8-6ae3-49c3-b170-2296f44efef9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.419320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.419951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.420233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.420512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.465758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d468f-3aaf-4f51-9383-313d4e08bc82 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.481153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.496060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.497497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d9786-7b25-43c2-9758-1eb707a221b5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.503151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.503797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.504076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.504348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.515761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-734afb71-ae69-4cfd-be78-838aa0d319fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:06.520703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:06.521687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:06.522952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 426/843] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:06.523671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590f27-ec6a-4737-ac99-47e1a96a7406 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.524163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590f27-ec6a-4737-ac99-47e1a96a7406 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.524163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590f27-ec6a-4737-ac99-47e1a96a7406 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.529637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 427/844] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:06.530340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590f27-ec6a-4737-ac99-47e1a96a7406 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.605385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.614432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 418/845] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 12:39:06.614432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.614432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.614432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.630865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:06.632198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:06.648791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590f27-ec6a-4737-ac99-47e1a96a7406 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.686833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.687504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.687783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.688061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.688785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:06.689092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.690556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.710200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 419/846] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:06.710200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.710457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 428/847] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:06.711589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.747355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.811184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed5cc9-6ee6-4aeb-8994-e43bdcd873f3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.819708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be08-717c-4ed5-b9f1-84107bdda660 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:06.838384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:06.847210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.847852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.848135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.848416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.856759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:06.857630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:06.858139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:06.858635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:06.859312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.860751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.870158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:06.871844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:06.876207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:06.877101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:06.878087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:06.878087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:06.878087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:06.878087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:06.878087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 420/848] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:06.878380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:06.890923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:06.891870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:06.892812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:06.892812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:06.892812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:06.892812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:06.892812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 429/849] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:06.893090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:06.987443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.004704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5dce-c8d8-4e79-b91d-1fa716121bc7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.005069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891baea-0428-4e8a-8785-d7f718d0c821 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.040764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.041404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.041701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.041998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.042724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.044092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.048734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.049352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.049634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.049938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.050683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.050993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.052329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:07.054547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:07.055534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:07.056471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 421/850] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:07.057302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.071066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 430/851] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.074728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.108351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.166805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde88527-8f72-4cce-8507-4f732b59a50f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.182195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c86cb-fee8-4724-b3cf-d73fc71ae619 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.201396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.202034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.202317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.202591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.203274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.203576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.204923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.218185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.218812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.219100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.219381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.220063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.220370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.221731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.223007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 422/852] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.223923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.227298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 431/853] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.227958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.240262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.334786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9cb6-ab4b-4378-adf8-3b1f394c7616 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.337304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2225313-c032-4c84-8fd4-03fc4d26b876 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.338324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.380693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.381916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.382370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.382608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.382726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.383688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.384159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.384711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.390022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.391461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.392526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.393979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:07.406043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:07.406997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 12:39:07.407964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:07.408504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:07.409308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 423/854] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:07.410229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.411751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 432/855] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:07.414799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.491386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.521795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e317eb-ae30-4b90-a084-cdf7bb78e7db None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.526561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4946-795b-427c-a257-34af77f29b5e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.557486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.558126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.558407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.558679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.559388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.559648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.560994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.561338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.561995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.562437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.562726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.563798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.564112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.565533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.566190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 424/856] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.567106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.592306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 433/857] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.598456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.609966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.704913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ab8f-11c1-457d-97fc-76d717595ccf None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.733898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c940-1960-431d-ab06-000c95a2a44c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.750386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.751353 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.751846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.752340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.753275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.753493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.755119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.766085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.776056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 425/858] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.780888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.781572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:07.781717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.782057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.782333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:07.783193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=71beef48ee884f8fafc75df6766d1064) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:07.783504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:07.785213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:07.793848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 434/859] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/role_assignments?user.id=71beef48ee884f8fafc75df6766d1064&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:07.888746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:07.907937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1b55-0019-4822-8e78-c18738bf150e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:07.949470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:07.950130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:07.950413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:07.950689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.028220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.029602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621d54-50a9-49cb-a28b-560c064b2c52 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.127737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.143946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 426/860] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:08.150928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.258703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61e6c7-5566-43df-be39-8a3047f4d292 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.284184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6bb-2850-406e-b3c4-a7b17a31970d None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.284775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6bb-2850-406e-b3c4-a7b17a31970d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.285252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6bb-2850-406e-b3c4-a7b17a31970d None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.288732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 427/861] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:08.293151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.293744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.294028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.294506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.294682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.294957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.295234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.306973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.308426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.316439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:08.318551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:08.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:08.324917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:08.330470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:08.330470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:08.330470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:08.330470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:08.330470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 435/862] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:08.332201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.386447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.421831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 428/863] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:08.437175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.452355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e161475-8b0b-49c0-9770-bdc81864c617 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.491759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.492748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.493321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.493800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.494842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:08.495369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.497030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.516330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 436/864] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:08.517966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.572576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bf9fa-f872-4f70-afb8-68273709e25b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.596816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.620252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.621736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.622275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.622770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.623687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.625249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.629169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b40d4-46fb-4038-b56b-c33a26478bd9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:08.635154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:08.636149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:08.637045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:08.639732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.645074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 429/865] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:08.647390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.673122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.674067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.674361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.674637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.685556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.687039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:08.702794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:08.703762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:08.704676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:08.708902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 437/866] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:08.710453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.772993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d00ed-4a2a-4eb6-b652-41cf2f0ae5b2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.810741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.811407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.811693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.811966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.812647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:08.812954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.814361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.820411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 430/867] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:08.826122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.844760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c1e7-c813-428f-a24a-552223a925ec None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.878656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.891011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.891642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.891929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.892212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.892971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:08.893283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.894748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.908047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 438/868] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:08.914806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:08.942899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:08.945266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963bd19-e7d2-4eea-acdd-93e42fb79e16 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:08.983697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:08.984539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:08.984970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:08.985431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:08.986332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:08.986783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:08.988330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf876f-7eca-4dd8-8ae6-0847d77f11a7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:08.999044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 431/869] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:09.030380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d7ebc-2c61-460e-87fa-c0197a602597 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:09.070910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:09.071561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.071846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.072126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.072960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=182ee307b1394f72bc71477eb027da49) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:09.073278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:09.074848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1991a00-afff-44f4-a81f-0fc826ca3bd5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:09.082422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 439/870] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:08 2022] GET /identity/v3/role_assignments?user.id=182ee307b1394f72bc71477eb027da49&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:09.717786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4337-86f9-4755-a07c-d1cc9abec8f7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.718365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4337-86f9-4755-a07c-d1cc9abec8f7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.718365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4337-86f9-4755-a07c-d1cc9abec8f7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.720172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 432/871] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:09.725672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a32576-b14c-4874-8771-3ac9cf6124fe None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.726073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a32576-b14c-4874-8771-3ac9cf6124fe None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.726435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a32576-b14c-4874-8771-3ac9cf6124fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.745422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-77a32576-b14c-4874-8771-3ac9cf6124fe None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:09.746666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-77a32576-b14c-4874-8771-3ac9cf6124fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:09.823107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 440/872] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:09.845779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4337-86f9-4755-a07c-d1cc9abec8f7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:09.953287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4337-86f9-4755-a07c-d1cc9abec8f7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:09.963341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:09.983328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58226-5a58-43cc-8c26-7b592bd0a5ea None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.983808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58226-5a58-43cc-8c26-7b592bd0a5ea None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.983808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58226-5a58-43cc-8c26-7b592bd0a5ea None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.985268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 441/873] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:09.990286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.991469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.991918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.994821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:09.995709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:09.996129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:09.996550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:09.997398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:09.999256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:10.011070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:10.012347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:10.022499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 433/874] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:09 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:10.039551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:10.114414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 442/875] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:10.138556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:10.252577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097da4-6550-4b92-ab4f-b6b6c5268f85 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:10.291429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:10.292075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:10.292359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:10.292685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:10.304138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:10.309621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:10.310591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:10.311435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 434/876] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:10.318951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:10.421982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f7bd-1d68-448e-a9dd-62d4958a408c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:10.456815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:10.457773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:10.458302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:10.458796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:10.460027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:10.460534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:10.462117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:10.470716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 443/877] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:10.477226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:10.509893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:10.585203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34a1f-0cce-4109-9a1e-009670d012c7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:10.620239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:10.621272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:10.621752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:10.622264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:10.633780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:10.635508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:10.651088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:10.652046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:10.652952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:10.652952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:10.652952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:10.652952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:10.655127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 435/878] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:10.660845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:10.672755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:10.764496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736eb0-d415-4eb7-9c30-001a9ab07169 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:10.804205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:10.804839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:10.805127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:10.805409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:10.806224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:10.806537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:10.807913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:10.821842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 444/879] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:10.827397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:10.914015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:10.933926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7472-21a3-4364-af19-a6094bf97ca9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:10.968520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:10.969160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:10.969434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:10.969706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:10.978273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:10.979703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2fd0a3d8-2a41-490e-891a-4ddccd58ca7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:10.991502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:10.992473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:10.993429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 436/880] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:10.998597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.066813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42a49-5688-4d8f-8bc7-eb8b05e0c443 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.067114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42a49-5688-4d8f-8bc7-eb8b05e0c443 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.067362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42a49-5688-4d8f-8bc7-eb8b05e0c443 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.070896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 437/881] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:11.074955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.075439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.076244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.078873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.095466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:11.096967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:11.119463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb861d-3752-4477-a58c-2f3a4bcafedd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.166505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.167134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.167414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.167689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.168769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:11.169075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.170679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.182308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 438/882] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:11.191311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 445/883] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:39:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:11.197142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.203357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.271790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.308495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9078-2d09-4d66-8c19-901e011f672b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.344499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557446-5693-4ca0-b1c2-88c91089ed7f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.347916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.348540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.348822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.349101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.374208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.385701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.386425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.386713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.386997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.387759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.389136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e6cae-a2c8-4c38-bbe2-ecd2dfd2acc4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.407466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 446/884] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:11 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:39:11.409063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaab6-4029-4b27-96e4-c798cb50a9b1 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.409359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaab6-4029-4b27-96e4-c798cb50a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.409635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaab6-4029-4b27-96e4-c798cb50a9b1 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.411017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 447/885] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:11.417392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.417697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.418016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.440351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.442204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.443276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:11.445178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:11.540873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.541478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 448/886] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:11.560702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.579018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 439/887] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:11.585132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.690504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dee33-3c82-4d6d-b3ba-aed38327e016 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.704203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fc4d9-2373-474e-b90e-924d2d1d44e9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.711985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.737467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.738498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.739002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.739485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.740492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.742389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.742734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.743783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.744161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.744537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:11.752691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:11.753966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:11.754922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:11.758055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 449/888] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:11.761315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.763297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.763681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:11.783679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:11.784666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:11.785583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:11.785583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:11.785583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:11.785583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:11.792500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 440/889] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:11.793350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.825605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:11.891401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38c64-9608-4ebc-800b-ff7e9a699d15 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.908232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196379-ff8d-43bb-92eb-4511c4b5fd20 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:11.929301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.930056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.930264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.930541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.931237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:11.931558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.932921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.942736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 450/890] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:11.943738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.949552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:11.950478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:11.950957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:11.951441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:11.952323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:11.952888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:11.954484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:11.972615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 441/891] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:11.973832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:11.987366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.049007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fd3c-2faa-4ea9-8451-2db936e751fa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.086019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.086575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.086862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.087143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.087833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:12.088141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.089539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.102130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 451/892] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:12.103455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a6a35-c18a-4f2b-b4ba-7c8b06c06311 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.118350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.144463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.145607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.146123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.146595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.155594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.157468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-5dfc6927-3c1f-45aa-ba82-d5b2920ccd10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:12.171350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:12.172342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:12.173248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:12.180827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 442/893] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:12.182256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.226136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f46d9-4d30-45cc-b68a-40d637853d15 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.226868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f46d9-4d30-45cc-b68a-40d637853d15 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.227355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f46d9-4d30-45cc-b68a-40d637853d15 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.229431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 443/894] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:12.234701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.234986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.235259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.254726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:12.255966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:12.297131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0630aa-e5e1-4691-a533-1a9f5230b2e7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.300454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.340691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.341405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.341688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.341979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.342745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:12.342855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 444/895] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:12.343038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.344462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.357175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 452/896] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:12.363066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.367789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.452144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.482584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d8da9-372f-4f71-8b9c-7eeea596c3b9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.489328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08350c3-c9e0-4a5e-923c-a5c3bac3cbde None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.525176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.525970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.526299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.526645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.527433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.529082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.533932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.534785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.535238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.535693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.536649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] RBAC: Adding query filter params (role.id=c97eba7b60244e0c944b0319fc4a2a31, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=71beef48ee884f8fafc75df6766d1064) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:12.537174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.539971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:12.540085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:12.541039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:12.541920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:12.546039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 453/897] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:12.546973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.549980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 445/898] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/role_assignments?user.id=71beef48ee884f8fafc75df6766d1064&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=c97eba7b60244e0c944b0319fc4a2a31 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:12.587531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.679907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874432-7fc7-43d3-b949-8aec1a797baa None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.717589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.718248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.718533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.718816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.719508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:12.719818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.721196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.727314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 454/899] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:12.732697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.839554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08454ae-371c-42bf-adc3-ce748e27aa08 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:12.875135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:12.875755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:12.876039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:12.876315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:12.877006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:12.877312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:12.878700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:12.880886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:12.885296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 446/900] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:12.892479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:12.998284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:13.001165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5d7e-3d77-49c1-ab15-73df1f9d8dde None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:13.043591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:13.044459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.044883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.045339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.046297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] RBAC: Adding query filter params (interface=public, service_id=58288fb85e7e41178938ee43925d0dc4, region_id=RegionOne) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:13.046751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:13.048255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b45db1-0fe1-47d0-9c70-6d572d98cb8e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:13.054244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 455/901] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:12 2022] GET /identity/v3/endpoints?service_id=58288fb85e7e41178938ee43925d0dc4&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:13.062897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:13.167095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd403d3-10a6-40f5-b9e2-da73ba1d77b6 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:13.203309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:13.203936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.204218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.204495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.205150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:13.206536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ef0c-b917-4fc8-aaad-6209d5dc7fb6 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:13.212648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 447/902] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:13 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:39:13.512276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c38b3-d4a1-4e4f-9ab3-e8928091e808 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.512616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c38b3-d4a1-4e4f-9ab3-e8928091e808 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.512955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c38b3-d4a1-4e4f-9ab3-e8928091e808 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.514640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 456/903] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:13.519797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.520087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.520363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.540456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:13.541634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:13.604538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:13.613490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 448/904] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:13.635715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c38b3-d4a1-4e4f-9ab3-e8928091e808 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:13.755457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c38b3-d4a1-4e4f-9ab3-e8928091e808 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:13.794615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:13.795179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.795457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.795734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.796365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:13.797797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:13.808578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:13.809524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:13.810404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 457/905] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Jul 26 12:39:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:13.815874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:13.916344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c43174-bb76-42b9-a445-26eca3bbef82 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:13.954762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:13.955386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:13.955662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:13.955988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:13.956676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:13.956979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:13.958369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:13.963649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 449/906] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:13.969275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:13.994180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:14.079518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae4fb-f7a7-426f-a3c6-3d24ea1fc6d5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:14.115329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:14.116265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.116555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.116840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.117524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:14.117848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:14.119234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:14.129115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 458/907] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:14.130509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:14.192608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:14.236220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722fee-eea3-41d8-8932-09305c878c7e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:14.271355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:14.272857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.273316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.273764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.274718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] RBAC: Adding query filter params (interface=public, service_id=d3b9783d0ada467fb94e434df1fd8b2b, region_id=RegionOne) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:14.275226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:14.276749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44448b0-d74e-4d19-9c50-5d579daf20d9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:14.284850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 450/908] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:14 2022] GET /identity/v3/endpoints?service_id=d3b9783d0ada467fb94e434df1fd8b2b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:14.290277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:14.338566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a399d3-571d-44c8-a5ba-273635511404 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.338775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a399d3-571d-44c8-a5ba-273635511404 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.339037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a399d3-571d-44c8-a5ba-273635511404 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.340653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 451/909] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:14.345625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7606-02ef-4338-a21c-75bf460f6e71 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.345943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7606-02ef-4338-a21c-75bf460f6e71 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.346221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7606-02ef-4338-a21c-75bf460f6e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.370755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-abfd7606-02ef-4338-a21c-75bf460f6e71 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:14.371942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-abfd7606-02ef-4338-a21c-75bf460f6e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:14.384816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:14.407338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6de0b-0fc1-4d5a-bb8e-e47a98477b60 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:14.449184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:14.449868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.450418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.450699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.451361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:14.452727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:14.469851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 459/910] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:14 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:39:14.478258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 452/911] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:14.498332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:14.620552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25472f-afef-4445-8770-50d4b54da288 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:14.660933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:14.661551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.661857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.662140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.664030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:14.665385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea524-76be-484c-a095-045554d640c3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:14.681432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 460/912] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:14 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:14.745760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d040-b552-4afe-8254-9ae442b82b0b None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.746143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d040-b552-4afe-8254-9ae442b82b0b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.746354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d040-b552-4afe-8254-9ae442b82b0b None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.747977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 453/913] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:14.753236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:14.753522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:14.753802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:14.783172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:14.784451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:14.786772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:14.891966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 461/914] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:14.914932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0d040-b552-4afe-8254-9ae442b82b0b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:14.989429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:15.054476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0d040-b552-4afe-8254-9ae442b82b0b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.127444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.128516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.129092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.129898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.151741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:15.159801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:15.160732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:15.161621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:15.171274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 454/915] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:15.174396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.287940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a66f1-330f-4b3c-8e9f-bd466cc616f4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.328748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.329374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.329655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.329958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.330682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:15.330987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.332354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1de79-b032-46bc-9900-4856c2558fb9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.333778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:15.342639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 462/916] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:15.347979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.456625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170007-aeca-4073-a163-0f7fad4f54da None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.459750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6eaf3-edb0-4ca9-86c8-7b6e18db8b64 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.460190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6eaf3-edb0-4ca9-86c8-7b6e18db8b64 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.460408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6eaf3-edb0-4ca9-86c8-7b6e18db8b64 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.462042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 463/917] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:15.466815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.467099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.467374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.471850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:15.493362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:15.494885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:15.495013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.495625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.495908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.496182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.507695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.509138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:15.524404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:15.525335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:15.526676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:15.526676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:15.526676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:15.526676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:15.530425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 455/918] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:15.531266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.583668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 464/919] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:15.606022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.639083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beb9fa-b7d5-4735-87f2-a03fcea2d35c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.674129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.675055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.675401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.675747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.676498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:15.676888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.678645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.695854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 456/920] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:15.697298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.718733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880938-e205-48ec-9ece-1717f9707ca7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.723135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:15.754180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:15.759299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.759937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.760221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.760496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.761119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.762789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:15.772815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:15.773864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 12:39:15.774731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:15.779123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 465/921] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:15.780042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.811118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5bcd-d580-41b4-9669-6ef84534e18d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.848286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.849324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.850491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.851052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.859038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.860763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:15.874718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:15.875722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:15.876692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:15.883774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 457/922] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:15.884906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.892543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7235a5-3280-4a30-9f15-f9fadd2058af None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:15.934067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:15.934691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:15.934972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:15.935248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:15.935935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:15.936355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:15.937917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:15.948656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 466/923] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:15.949549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:15.988975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.011802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929d2-2d24-4f94-95ad-15ebdccc2fe9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.025417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.058126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.058629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.058911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.059185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.059978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:16.060281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.061697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.084655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 458/924] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:16.085520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.086940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb175-a3ad-4929-98b9-72b01608a19c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.125317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.126327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.126903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.127374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.128261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:16.128870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.130590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.141665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 467/925] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Jul 26 12:39:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:16.142756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.189352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9be4-b1ef-4cdb-b4e7-564a38555e59 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.226521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.226998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.227280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.227557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.238067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.239563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.241646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:16.255601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:16.257129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:16.258058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:16.258058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:16.258058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:16.258058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:16.260323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb090-4f29-444a-86ce-e9571d287d97 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.262040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 459/926] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:16.263073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.280712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.301588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.302515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.303102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.303633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.304527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.306190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.338315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 468/927] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:16.375464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d1d2a-b6e9-4ffe-9d3b-d2d0ef1a571e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.421076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.421708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.422014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.422290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.422988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:16.423301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.424699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.438985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 460/928] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:16.447800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.559474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb3f7-ef8a-453a-9fde-a79c407fbfdf None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.594336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.594985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.595270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.595547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.603076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.604532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:16.617239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:16.618264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:16.619230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 469/929] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:16.624643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.681140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.731100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262481-2209-4ba3-897d-ae5bb3a3b0a9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.767896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.768521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.768805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.769078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.769850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:16.770162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.772099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d628c-e875-4237-9ecd-268bc2e8b445 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.784736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 461/930] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:16.791333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:16.794646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6c4-f68b-4bfc-ac5d-99e92fd8aefb None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.794936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6c4-f68b-4bfc-ac5d-99e92fd8aefb None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.795215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6c4-f68b-4bfc-ac5d-99e92fd8aefb None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.796777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 462/931] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:16.801589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75040622-744d-487a-9acb-1197b0ad8092 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.801919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75040622-744d-487a-9acb-1197b0ad8092 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.802189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75040622-744d-487a-9acb-1197b0ad8092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.823310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-75040622-744d-487a-9acb-1197b0ad8092 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:16.824568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-75040622-744d-487a-9acb-1197b0ad8092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:16.838230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.904158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 463/932] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:16.905642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cb28-2304-4707-9d18-ab1b0a5e462d None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.905970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cb28-2304-4707-9d18-ab1b0a5e462d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.906248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cb28-2304-4707-9d18-ab1b0a5e462d None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.907605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 464/933] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:16.913490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.913777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.914075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.923274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863ced-90d1-459b-91fc-d72ba8af3cb9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:16.934427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:16.935615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:16.962627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:16.963394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:16.963681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:16.963958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/71beef48ee884f8fafc75df6766d1064/roles/c97eba7b60244e0c944b0319fc4a2a31` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:16.966198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=71beef48ee884f8fafc75df6766d1064, role_id=c97eba7b60244e0c944b0319fc4a2a31)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:16.967646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:16.980423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:16.984143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 470/934] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:16 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/71beef48ee884f8fafc75df6766d1064/roles/c97eba7b60244e0c944b0319fc4a2a31 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:39:16.994921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.025867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 465/935] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:17.044845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.156478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:17.164578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c8e9-7eb4-4755-a800-49b5bb4473d0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.175853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7e62-d395-4c13-bc55-1f6245ea3b30 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.209855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.210500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.210783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.211059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.211685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.213042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.227656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.228292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.228573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.228847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.229471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.230902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:17.231727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:17.232714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 12:39:17.233606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:17.236127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 471/936] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Jul 26 12:39:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:17.245794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:17.245969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:17.247102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:17.248126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 466/937] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:17.257516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.302734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:17.358392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5bcf7-80c6-46b3-9fda-b4c1f7300b6c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.391992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be21ea-0b7b-43db-8332-57850da65efa None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.395922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.396816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.397317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.397801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.398725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:17.399237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.400852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.406766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 472/938] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:17.411828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.434292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.435314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.435854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.436344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.437414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:17.438038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.439651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.443843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:17.447059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 467/939] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:17.452907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.556070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9657-3131-4e41-a26b-8f03348d520e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.582452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:17.590752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c556e-5ced-4e35-81bf-350b16bbf597 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.601834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.602492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.602778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.603053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.603742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:17.604048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.606396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.617621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 473/940] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:17.619658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.640340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.640965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.641294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.641769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.642541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:17.642849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.644966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.653887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 468/941] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:17.658717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.734615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:17.750270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437553ef-748f-4aa5-833b-8c10aad1e030 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.785591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb0ac-6406-4ba2-b68e-25de64897b62 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:17.786163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.786787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.787071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.787525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.788290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.789771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.820585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 474/942] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:17.842865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:17.843629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:17.843972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:17.844248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:17.845266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] RBAC: Adding query filter params (interface=public, service_id=5aeb3b2a7b8d40bda071544ddc2ce477, region_id=RegionOne) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:17.845633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:17.847211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fe7d-b2ea-40ef-b3b9-2fefca8ef57e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:17.859511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 469/943] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/endpoints?service_id=5aeb3b2a7b8d40bda071544ddc2ce477&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:17.861033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:17.976144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b7c6-40b2-453d-b06f-8ac8a3cf41a4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:18.013901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:18.014523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:18.014965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:18.015088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:18.015732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:18.017096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60b17-d43d-45ea-9337-7071cb0f9a3c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:18.027392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 475/944] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:17 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:39:18.515032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c136-b8f8-4b82-b999-3153f8db4861 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:18.515032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c136-b8f8-4b82-b999-3153f8db4861 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:18.515032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c136-b8f8-4b82-b999-3153f8db4861 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:18.516004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 470/945] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:18.521296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:18.522791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:18.523566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:18.536952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:18.542991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:18.545167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:18.617011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 476/946] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:18.640776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4c136-b8f8-4b82-b999-3153f8db4861 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:18.669617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:18.757973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4c136-b8f8-4b82-b999-3153f8db4861 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:18.794589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:18.795540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:18.796036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:18.796515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:18.797422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:18.799122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:18.802019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING keystone.server.flask.common [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 12:39:18.821857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.sql.core [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 12:39:18.821857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 12:39:18.821857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [parameters: {'id': '9e35c3a06fc34a1dabd5305a358270b2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 12:39:18.821857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91771) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-74722316-2b92-435f-b92c-c8f9afbc73df None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e35c3a06fc34a1dabd5305a358270b2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e35c3a06fc34a1dabd5305a358270b2. Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:39:18.840044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application result.read() Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 12:39:18.840909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application yield resource Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise self.value Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application session.commit() Jul 26 12:39:18.841923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self.session.flush() Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application compat.raise_( Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 12:39:18.842835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 12:39:18.844815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application result.read() Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:39:18.846792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [parameters: {'id': '9e35c3a06fc34a1dabd5305a358270b2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:18.849075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:18.851211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e35c3a06fc34a1dabd5305a358270b2. Jul 26 12:39:18.854736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:18.856700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 471/947] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Jul 26 12:39:18 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:18.864231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:18.967750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc33338-233b-4049-875b-ed8622601ff3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.004120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.004776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.005066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.005407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.008555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:19.013445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:19.015702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:19.028785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c82f6-ca9c-4f8a-af06-12d9af1bafac None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.029427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c82f6-ca9c-4f8a-af06-12d9af1bafac None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.029965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c82f6-ca9c-4f8a-af06-12d9af1bafac None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:19.030410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:19.031312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:19.032280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 477/948] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:19.037859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 472/949] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:19.041634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.043851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.043851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.043851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.063704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:19.065116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:19.151323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 473/950] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:19.161594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f734f-2b8d-4be2-95fc-44061ce82174 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.174053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.190215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:19.199393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.200032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.200309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.200577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.201319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:19.201620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:19.203104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:19.221984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 478/951] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:19.298670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ff62c-ef8e-46a2-93c7-e7500ed3bec9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.337652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.338338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.338619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.338895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.352776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:19.358077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:19.359306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:19.360209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 474/952] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:19.365918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.430386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:19.478547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31200f-755c-4288-9b8d-2507c58a11cd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.522188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.522188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.522188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.522188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.523246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:19.523246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:19.523246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:19.532111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 479/953] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:19.538963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.609612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:19.645759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60176061-a2ea-44eb-878c-f0d65330d09a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.685772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066a836-060c-4e05-8828-c270f816585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.686449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066a836-060c-4e05-8828-c270f816585a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.686732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066a836-060c-4e05-8828-c270f816585a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.687007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066a836-060c-4e05-8828-c270f816585a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.697708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066a836-060c-4e05-8828-c270f816585a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:19.699344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066a836-060c-4e05-8828-c270f816585a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a066a836-060c-4e05-8828-c270f816585a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:19.715264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:19.716312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:19.717299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:19.717299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:19.717299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:19.717299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:19.717299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 475/954] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:19.722206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.833720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d69b4-7238-4891-b85f-9e1a75c2d6cc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:19.853363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:19.873674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:19.874666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.875159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.875649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.876654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:19.877175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:19.878773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc21e2-bc82-4403-8b7f-6244835cd034 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:19.891817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 480/955] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:19.897862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066a836-060c-4e05-8828-c270f816585a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:19.942093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578840-8b94-4ddb-95b8-32f36af9ab56 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.942419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578840-8b94-4ddb-95b8-32f36af9ab56 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.942648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578840-8b94-4ddb-95b8-32f36af9ab56 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.944795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 481/956] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:19.949703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:19.950018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:19.950294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:19.968407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:19.969586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:20.017093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066a836-060c-4e05-8828-c270f816585a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.051480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.065962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 482/957] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:20.075886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.076846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.077354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.077894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.087014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.090916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.092332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:20.105521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:20.106707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:20.107781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 476/958] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:39:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:20.112791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.196781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65458c2-27b6-4382-a8db-0081fcec53cd None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.205842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.223894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004f476-9d54-4ef4-a742-c5ef73652a18 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.233533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.234216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.234499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.234772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.235421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.236783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f255dbb6-6ac3-4b9e-88e4-afde62b96718 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:20.246413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:20.247499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.248417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 483/959] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:20.249285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddda2b-d738-405a-9a4b-c07acf92e77f None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.249285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddda2b-d738-405a-9a4b-c07acf92e77f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.249285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddda2b-d738-405a-9a4b-c07acf92e77f None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.250579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 484/960] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:20.253461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddda2b-d738-405a-9a4b-c07acf92e77f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.266783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.267493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.267749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.267984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.268737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:20.269047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.270502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df59ed-1c3b-41db-a500-a10627a3bda7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.288562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 477/961] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:20.291055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.291609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.292129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.312342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:20.313732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:20.346151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.370188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddda2b-d738-405a-9a4b-c07acf92e77f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.385861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 478/962] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:20.386025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.415205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.415833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.416116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.416392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.417067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:20.417375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.418765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.424295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 485/963] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:20.430481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.466784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.494320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee070-1b48-4677-811d-eb42d2883131 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.531684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.532769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.533066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.533329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.535634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539febf-2d86-4206-91c2-aac2226ab094 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.570806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.572131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.572935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.573244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.573582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.574244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.575619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:20.586142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:20.587178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.588026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 486/964] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:20.588844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.612795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.614547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.695264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.698848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7bed4-c227-48c0-b2ed-0e939324492b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.728714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 479/965] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:20.728714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.739222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.739840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.740121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.740424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.741498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:20.741830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.743187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.757411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 487/966] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:20.757411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.816714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:20.857563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e778-a573-4343-abf7-6de6cb773c3e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.898017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d4dc-9b4b-4f3e-b5b9-2a77efd39fe3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:20.898532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.899240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.899596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.900075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.900995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:20.901367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.902858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.914386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 480/967] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:20.915831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:20.945082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:20.945793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:20.946380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:20.946658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:20.962563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:20.963970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:20.983547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:20.984511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:20.985759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:20.985759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:20.985759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:20.985759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:20.985759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 488/968] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:20.990170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.018185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.047404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b1d3-267b-4d0b-bf5a-38e1504534d4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.087984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.098536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.100464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.100923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.101349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.102711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:21.103192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.105464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.118364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 481/969] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:21.120457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.134242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefbbc8-1f05-4749-9364-e61c78505380 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.179454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.180461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.180977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.181472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.182415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:21.182940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.184531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.197933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 489/970] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:21.203585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.235476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffcb81-3a1c-4469-82d7-bf5d9e0d8b8f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.273179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.273793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.274097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.274369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.275075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.276433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.288633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.300631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 482/971] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:39:21.316914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca9d0-d16c-4a70-bc0f-a1f404a88bae None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.366741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.367795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.368289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.368769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.377150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.379135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d98235da-eb43-412a-923f-9c9ae09549c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:21.392329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:21.393300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:21.394256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.397371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 490/972] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:21.406976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.448205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab338-3110-4885-9d99-04ca6e10fef6 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.448536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab338-3110-4885-9d99-04ca6e10fef6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.448757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab338-3110-4885-9d99-04ca6e10fef6 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.450386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 491/973] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:21.455702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.455979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.456258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.471866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.476602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:21.477841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:21.540021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485703f-8b1b-49da-9c2f-52dbbdae03fc None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.564723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 492/974] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:21.583321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.585231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.585678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.586163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.587071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:21.587557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.589577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.590795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.607818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 483/975] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:21.613855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.661716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.704295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92417110-0ac8-419a-8fe3-a65378f2cb1c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.747392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.748376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.748846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.749356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.750290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.751794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.754433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING keystone.server.flask.common [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 12:39:21.756441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304675d-a4f8-4ceb-a2e7-71d3dc1b6217 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.767466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.sql.core [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 12:39:21.767466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 12:39:21.767466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [parameters: {'user_id': '777dbf6fb164462e96c9f4f473fbed00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 12:39:21.767466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 12:39:21.773975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result.read() Jul 26 12:39:21.778019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:39:21.778970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application yield resource Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application next(self.gen) Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise self.value Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application session.commit() Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 12:39:21.779975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.session.flush() Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application compat.raise_( Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 12:39:21.780890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 12:39:21.781897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application conn.query(q) Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application result.read() Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 12:39:21.782871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [parameters: {'user_id': '777dbf6fb164462e96c9f4f473fbed00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:21.783728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 12:39:21.784546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.785761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 493/976] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Jul 26 12:39:21 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:21.787505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:21.813115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.814181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.814662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.815618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.816887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] RBAC: Adding query filter params (role.id=c97eba7b60244e0c944b0319fc4a2a31, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=71beef48ee884f8fafc75df6766d1064) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:21.817351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.820320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.829584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 484/977] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:21 2022] GET /identity/v3/role_assignments?user.id=71beef48ee884f8fafc75df6766d1064&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=c97eba7b60244e0c944b0319fc4a2a31 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:21.918366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeaebd-fc6d-4fe2-8d33-cb68366e8bb9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:21.945190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:21.958664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:21.959865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:21.960404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:21.960754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:21.970217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:21.972028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2fb44c77-31d2-414e-b690-b371efe5ccae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:21.984804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:21.986067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 12:39:21.987253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:21.987890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 494/978] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:21.994769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:22.125449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6e67-dc6f-42e4-b3cd-b56441dc427b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:22.160782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:22.161404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:22.161685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:22.162073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:22.163548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:22.163853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:22.165275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f77a-e4fc-4477-b8aa-998c8fd840ed None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:22.200569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 485/979] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Jul 26 12:39:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:22.847696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7880d-6b68-48c5-a817-ea5c9eef7b97 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:22.848253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7880d-6b68-48c5-a817-ea5c9eef7b97 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:22.848253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7880d-6b68-48c5-a817-ea5c9eef7b97 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:22.852848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 495/980] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:22.857800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65a4f-d2dd-497e-bd43-a54dbfcec00c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:22.858230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65a4f-d2dd-497e-bd43-a54dbfcec00c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:22.858437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65a4f-d2dd-497e-bd43-a54dbfcec00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:22.876924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-84a65a4f-d2dd-497e-bd43-a54dbfcec00c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:22.878111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-84a65a4f-d2dd-497e-bd43-a54dbfcec00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:22.906650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:22.948809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 486/981] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:22.970654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7880d-6b68-48c5-a817-ea5c9eef7b97 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:23.083701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7880d-6b68-48c5-a817-ea5c9eef7b97 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:23.117892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:23.118432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.118713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.118986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.119681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:23.121046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72f2e7-d460-4455-96f6-4fa677b278bb None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:23.135999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 496/982] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:22 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:23.429207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffeafa-1592-4886-917d-45c4337cb128 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.429398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffeafa-1592-4886-917d-45c4337cb128 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.429659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffeafa-1592-4886-917d-45c4337cb128 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.431204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 487/983] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:23.436338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.436637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.436927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.457283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:23.458845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:23.500224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:23.536800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 497/984] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:23.559921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffeafa-1592-4886-917d-45c4337cb128 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:23.665829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffeafa-1592-4886-917d-45c4337cb128 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:23.700186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:23.700745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.701028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.701306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.701964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:23.703326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:23.713539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:23.714715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:23.715607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:23.718137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 488/985] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:23.720801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:23.822813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894745-6261-42ff-b60d-5152ef3bdda8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:23.857701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:23.858424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.858669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.858903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.859585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:23.859896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:23.861262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787b6f7-8e08-4d8c-8d58-8e807935d601 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:23.870337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 498/986] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:23.872492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:23.903001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:23.941329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbbfe-4575-490f-bcc4-019acbc519c8 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.941647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbbfe-4575-490f-bcc4-019acbc519c8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.941929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbbfe-4575-490f-bcc4-019acbc519c8 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.943946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 499/987] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:23.948700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:23.949003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:23.949286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:23.967320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:23.968429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:23.981017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a424e51-98bd-456c-9b18-2dd0622e8645 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:23.995791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:24.021316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.022312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.022775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.023211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.023903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:24.024211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.025580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.030834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 489/988] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:24.036343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:24.051153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 500/989] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:24.066878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:24.136826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:24.148190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c39-152c-4ba0-8909-88b7c139a2f3 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:24.186429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.186660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5580-c0a6-47e8-8fd6-e0c9fbcf9e6a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:24.187041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.187323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.187598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.188576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] RBAC: Adding query filter params (interface=admin, service_id=5aeb3b2a7b8d40bda071544ddc2ce477, region_id=RegionOne) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:24.188898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.190283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.196727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 490/990] 10.222.0.47 () {56 vars in 1249 bytes} [Tue Jul 26 12:39:24 2022] GET /identity/v3/endpoints?service_id=5aeb3b2a7b8d40bda071544ddc2ce477&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:24.202200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:24.224003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.224641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.224988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.225260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] PATH_INFO: `/v3/services/image` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.225930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.227304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:24.238030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:24.239085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:24.240001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 501/991] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Jul 26 12:39:24 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:24.246169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:24.279173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:24.323930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91959b-da20-400f-a0ea-78586b8ccfbc None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:24.357257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b580-a1bd-4dfc-ab28-e09e8243b549 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:24.361430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.362085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.362369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.362644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.363300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.364664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.373847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 491/992] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:24 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:39:24.396954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.397718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.398038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.398324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.399040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] RBAC: Adding query filter params (name=image) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:24.399355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.400778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b306b2-2c97-4c8e-8615-6d9ccc4f7ee1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.406571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 502/993] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:24.412357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:24.437197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:24.523710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199ae2-9b9b-4e08-bf48-10ad9faa7507 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:24.561111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:24.561743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:24.562062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:24.562342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:24.563033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] RBAC: Adding query filter params (type=image) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:24.563342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:24.564701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a7817-9c2e-4eb8-96c1-16bb8df1830b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:24.570760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 492/994] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:25.147953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643d19-0d45-4b92-8659-27444a473ddc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.148470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643d19-0d45-4b92-8659-27444a473ddc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.148549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643d19-0d45-4b92-8659-27444a473ddc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.149909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 503/995] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:25.154951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.155370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.155531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.174533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:25.175721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:25.245127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 493/996] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:25.267661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b643d19-0d45-4b92-8659-27444a473ddc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:25.362065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:25.373637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b643d19-0d45-4b92-8659-27444a473ddc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:25.406868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:25.407513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.407795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.408069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.408749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:25.410162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:25.419653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:25.420663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:25.421529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:25.425642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 504/997] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:25.426938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:25.443756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:25.535171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c9a19-202a-442a-80c8-dd0a44e5051a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:25.570453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:25.571180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.571464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.571740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.572421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] RBAC: Adding query filter params (name=compute) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:25.572727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:25.574107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:25.583508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 494/998] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:25.585606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:25.691833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281358-a4bf-4842-a33e-8558d368ab33 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:25.726947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:25.727568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.727847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.728125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.728795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:25.729124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:25.730483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:25.740652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 505/999] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:25.742186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:25.821890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:25.845151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090663-2b05-4ec0-80ce-4a51190fb87d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:25.880703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:25.881933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:25.882259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:25.882538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:25.883290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] RBAC: Adding query filter params (interface=public, service_id=7b940811ddcd4a85becb0ddef348f86b, region_id=RegionOne) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:25.883598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:25.884943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9987-1113-4c62-b354-a982be1a33aa None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:25.894625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 495/1000] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:25 2022] GET /identity/v3/endpoints?service_id=7b940811ddcd4a85becb0ddef348f86b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:25.895798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:25.918231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:26.000347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568e40-8471-4e73-89c6-db453a0cbb91 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:26.041373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:26.041952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.042238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.042515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.043180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:26.044537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4494301-d54a-4dda-9548-b7a21da380b5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:26.057838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 506/1001] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:25 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:39:26.388209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19c46-235b-4140-9556-dbf94f062373 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.388735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19c46-235b-4140-9556-dbf94f062373 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.388735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19c46-235b-4140-9556-dbf94f062373 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.390257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 496/1002] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:26.395223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955cebe-ed3e-4c3e-b62d-3347f9215a7f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.395638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955cebe-ed3e-4c3e-b62d-3347f9215a7f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.395805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955cebe-ed3e-4c3e-b62d-3347f9215a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.415147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6955cebe-ed3e-4c3e-b62d-3347f9215a7f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:26.416318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6955cebe-ed3e-4c3e-b62d-3347f9215a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:26.482897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 507/1003] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:26.504685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df19c46-235b-4140-9556-dbf94f062373 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:26.578282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68705d-b6b3-47de-a1a7-42bfe268b98e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.578605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68705d-b6b3-47de-a1a7-42bfe268b98e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.578841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68705d-b6b3-47de-a1a7-42bfe268b98e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.580335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 508/1004] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:26.586143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.586435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.586718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.605423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:26.606631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:26.608121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df19c46-235b-4140-9556-dbf94f062373 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:26.616715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:26.647871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:26.648803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.649246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.649660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.650455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:26.651942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:26.661013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:26.662819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 12:39:26.663943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:26.671131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 497/1005] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Jul 26 12:39:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:26.671833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:26.680998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:26.685942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 509/1006] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:26.701841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:26.778429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d77cf-e392-49bb-acea-9d20603710e0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:26.809932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5c084-e084-4842-9ee9-d199f5ac9b44 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:26.814810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:26.815660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.816116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.816563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.817426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:26.817731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:26.819618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:26.829625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 498/1007] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:26.830299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:26.848411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:26.849050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.849311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.849662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.850665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:26.852031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:26.868690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 510/1008] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:26 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:39:26.905560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:26.940928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e549f-eff3-4b87-9ab6-c345d76f0084 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:26.984516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:26.985248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:26.985593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:26.985974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:26.986733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:26.987107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:26.988560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da153c-86d6-4d19-bff6-2795a954c4ad None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:26.999151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 499/1009] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Jul 26 12:39:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:27.000442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:27.004467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:27.120195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3e09-a733-4011-b67d-3fc5be22dba5 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:27.155696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:27.156235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:27.156520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:27.156799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:27.157544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:27.158936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe314703-9663-412c-99f2-a420cf616591 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:27.176927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 511/1010] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:39:28.090262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729b01-f08a-464a-b729-0f0b2ef2e834 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.090769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729b01-f08a-464a-b729-0f0b2ef2e834 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.090848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729b01-f08a-464a-b729-0f0b2ef2e834 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.092323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 500/1011] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:28.097223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.097598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.097789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.116488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:28.117674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:28.176301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:28.193102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 512/1012] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:28.215260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8729b01-f08a-464a-b729-0f0b2ef2e834 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:28.323502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8729b01-f08a-464a-b729-0f0b2ef2e834 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:28.353053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:28.359826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:28.360469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.360750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.361022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] PATH_INFO: `/v3/services/compute` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.361650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:28.363061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:28.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:28.374364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:28.375238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 501/1013] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:28.382422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:28.481095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7347b-ecc7-4d4d-b9c9-940eb5c4a160 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:28.515294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:28.515923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.516207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.516490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.517171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] RBAC: Adding query filter params (name=compute) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:28.517481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:28.518881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:28.523744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 513/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:28.529475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:28.631541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a9740-a508-4dfb-b082-77144ca5f88d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:28.665938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:28.666557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.666840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.667116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.667792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:28.668102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:28.669458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c72-3762-4e43-b0a8-eb798067fde2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:28.679454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 502/1015] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Jul 26 12:39:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:28.680684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:28.739974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:28.793932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33870f9-3c70-4aae-b8e2-9f0ed5b1a39d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:28.828387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:28.829014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.829301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.829580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.830331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:28.831694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ce825-9b88-418a-80ea-60ca8df73e9c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:28.857706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 514/1016] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:28.939379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ef4e-3952-46c8-8c7e-ad42250b1337 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.939578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ef4e-3952-46c8-8c7e-ad42250b1337 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.939849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ef4e-3952-46c8-8c7e-ad42250b1337 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.941354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 503/1017] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:28.947593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaa2-eb0e-4892-a8c9-efd4612c7430 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:28.947905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaa2-eb0e-4892-a8c9-efd4612c7430 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:28.948174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaa2-eb0e-4892-a8c9-efd4612c7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:28.967045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-93dfeaa2-eb0e-4892-a8c9-efd4612c7430 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:28.968277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-93dfeaa2-eb0e-4892-a8c9-efd4612c7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:29.054727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 515/1018] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:29.077144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9ef4e-3952-46c8-8c7e-ad42250b1337 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.143617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.188754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9ef4e-3952-46c8-8c7e-ad42250b1337 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.222988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6399b5-d958-4465-b3f3-d4540f15a849 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.223480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6399b5-d958-4465-b3f3-d4540f15a849 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.223480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6399b5-d958-4465-b3f3-d4540f15a849 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.223784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.224346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.225143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.225423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] PATH_INFO: `/v3/services/image` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.225802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 516/1019] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:29.226076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.227437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.230836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.231115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.231400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:29.237407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:29.238715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:29.239583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 504/1020] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:29.245291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.257691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:29.259139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:29.291310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.331981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 517/1021] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:29.354835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3d93-bf9b-4ce6-bdcc-004d4ef4320e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.355707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.380753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.393742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.394397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.394718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.394992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.395670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] RBAC: Adding query filter params (name=image) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:29.395970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.397882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.407505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 505/1022] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:29.408505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.467900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc2d4-39d9-489a-bbf5-d11a31fa681d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.506669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.507231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.507525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.508234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.509658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.511613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.518918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 518/1023] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:29.519718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.519836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387af3-e167-499f-8634-97b8a1d5ff8c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.556892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.559639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.560266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.560556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.560831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.561513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] RBAC: Adding query filter params (type=image) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:29.561837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.563212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.568308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 506/1024] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:29.574007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.629643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.641605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a868d-a4c4-477f-8f5f-06f7e4c5a2c6 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.682574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.683200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.683489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.683767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.684453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.685927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.687464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d2a7-2df9-4072-82e3-324e241c8e76 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.714674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 519/1025] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:29 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:29.734980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.735612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.735900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.736176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.736940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] RBAC: Adding query filter params (interface=public, service_id=228e5e36431a470fbcd6218dfab912d2, region_id=RegionOne) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:29.737253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.738645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540b6b2-c379-4bc9-892a-f5e006a2166c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.745196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 507/1026] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/endpoints?service_id=228e5e36431a470fbcd6218dfab912d2&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:29.758026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:29.855215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:29.874360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92619c-47ea-4f88-9411-1ab9b66480ad None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:29.913275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:29.914276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:29.914568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:29.914849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:29.915567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:29.916939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ca7db-02b0-4ada-a005-9466e06a61e9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:29.924040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 520/1027] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:39:29 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:39:30.978532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad930-0269-4fa1-8896-a74f3cf3199e None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:30.979056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad930-0269-4fa1-8896-a74f3cf3199e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:30.979056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad930-0269-4fa1-8896-a74f3cf3199e None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:30.980546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 508/1028] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:30.985647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:30.986102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:30.986246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.004502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:31.005718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:31.083927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 521/1029] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:31.106693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad930-0269-4fa1-8896-a74f3cf3199e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.209200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad930-0269-4fa1-8896-a74f3cf3199e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:31.222407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:31.243257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:31.243821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.244099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.244377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.254779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:31.260289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:31.261234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:31.262133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:31.266098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 509/1030] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:31.267425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.349766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:31.370371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6ada-a68c-4ddb-99f9-49813eb2b697 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:31.405268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:31.405929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.406216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.406495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.407217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:31.407525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:31.408889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:31.421398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 522/1031] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:31.423160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.528501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561dea8-dd29-47d7-918c-af61e560c570 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:31.563931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:31.564583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.564867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.565145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.576846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:31.578341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:31.592899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:31.594123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:31.595060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:31.595060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:31.595060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:31.595060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:31.598154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 510/1032] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:31.600605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.702409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0606e1-9644-4aa8-b536-220e2d337da7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:31.736643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:31.737268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.737552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.737857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.738557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:31.738867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:31.740355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1af1-de6b-4a0c-9919-0ff5135077ec None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:31.757407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 523/1033] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:31.758926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.788215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:31.863855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085f97-0529-4e58-b76b-25b7c41bed0a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:31.898342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:31.898983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.899266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.899540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.905957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf17e-5fed-4f36-9f8d-9556f2013fe2 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.906377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf17e-5fed-4f36-9f8d-9556f2013fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.906755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf17e-5fed-4f36-9f8d-9556f2013fe2 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.908331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 524/1034] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:31.908629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:31.910182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:31.914102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0fc5-714f-49bf-8dbe-3f6fadc2a7ac None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:31.914498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0fc5-714f-49bf-8dbe-3f6fadc2a7ac None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:31.914867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0fc5-714f-49bf-8dbe-3f6fadc2a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:31.921125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:31.922874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:31.923837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:31.929699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 511/1035] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:31.930357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:31.941708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-68de0fc5-714f-49bf-8dbe-3f6fadc2a7ac None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:31.942938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-68de0fc5-714f-49bf-8dbe-3f6fadc2a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:32.009528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 525/1036] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:32.010813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8acd8-86f6-4889-8f52-67557fedd09e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.011104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8acd8-86f6-4889-8f52-67557fedd09e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.011383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8acd8-86f6-4889-8f52-67557fedd09e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.012639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 526/1037] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:32.017743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.018073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.018356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.019177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.037945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:32.039201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:32.043544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727db9-0085-4c78-a0c2-deeecc4e71f7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.079273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.079974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.080263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.080541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.081330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:32.081640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.083082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.102022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 512/1038] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:39:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:32.103021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.109869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 527/1039] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:32.109869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.169547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.206096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8527-9909-488f-92ae-d6a3dce0ca54 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.207389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f060e77-24a1-4732-a287-fb28991fa8b2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.239915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.240588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.240708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.240888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.241161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.241509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.241750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.242055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.242586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.244084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.245680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 513/1040] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:32.246540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.262653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.309508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.310915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.347630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f966-6765-4ca0-adba-dd33f50d5545 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.371839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.382095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.382721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.382999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.383271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] PATH_INFO: `/v3/services/image` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.383885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.385225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:32.393923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:32.395129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:32.396169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 514/1041] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:32.398036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.420375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 528/1042] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 12:39:32.420375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.472265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.496842 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa2e2-a8e7-4702-9c39-1f00124cd2bf None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.516880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3329c1-d24e-46c3-a3a4-b90af1a9e3a0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.530310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.530923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.531201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.531480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.532152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.533560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.550144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.550755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.551036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.551313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.551975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] RBAC: Adding query filter params (name=image) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:32.552277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.554198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.556930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 515/1043] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:39:32 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:32.557734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.564493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 529/1044] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:32.575123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.605726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.694029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe9c7e-8d69-47a5-bfb2-07c3aa28b626 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.694290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa937b6-efd1-44ec-95c7-87ff417d0783 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.729945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.737059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.737266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.737701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.737842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.738677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.738789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.738867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.738941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.739260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] RBAC: Adding query filter params (type=image) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:32.739573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.741970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.747616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 530/1045] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:32.754408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.755813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.757281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:32.774387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:32.775369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:32.776306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:32.776306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:32.776306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:32.776306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:32.776306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 516/1046] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:32.784557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:32.853043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:32.865775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a00-b04e-47db-a750-181efc66c6ec None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.898605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237c66-fa35-4b09-b6f0-056f314b76c7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:32.903743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.904374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.904658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.904934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.905648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.907167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.934013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 531/1047] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:39:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:39:32.949773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:32.950584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:32.950967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:32.951341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:32.952176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:32.952588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:32.954129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:32.973120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 517/1048] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:32.974666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:33.088421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff705b5-1b3d-4bed-b8b4-0ec9986a3229 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:33.125053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:33.125642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:33.125959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:33.126241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:33.134356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:33.135809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:33.147679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:33.148645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:33.150196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 532/1049] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:33.154629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:33.198456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:33.259215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf0cd-7360-431a-ae4a-9cec51b22937 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:33.295329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:33.296311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:33.296800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:33.297398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:33.298404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:33.298933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:33.300564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1089c53-0f97-443d-bf06-3462a005e942 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:33.313289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 518/1050] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:33.318968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:33.328880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:33.426219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae23ca-6144-4265-b6f1-ec64e5f1f53c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:33.461659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:33.462315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:33.462599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:33.462877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:33.463666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] RBAC: Adding query filter params (role.id=c97eba7b60244e0c944b0319fc4a2a31, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:33.463978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:33.465407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0780530-147c-463d-86a5-ac1ad1055717 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:33.471118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 533/1051] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:33 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=c97eba7b60244e0c944b0319fc4a2a31 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:34.620836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843799b-af1a-4a65-a9f0-0f05d9f5315e None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:34.621368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843799b-af1a-4a65-a9f0-0f05d9f5315e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:34.621368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843799b-af1a-4a65-a9f0-0f05d9f5315e None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:34.622936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 519/1052] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:34.627786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:34.628179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:34.628338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:34.647002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:34.648129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:34.711187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:34.717936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 534/1053] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:34.739811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843799b-af1a-4a65-a9f0-0f05d9f5315e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:34.841012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:34.846363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843799b-af1a-4a65-a9f0-0f05d9f5315e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:34.882157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:34.882716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:34.882999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:34.883276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:34.893945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-d1768094-ad69-447c-80a9-477b1591af4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:34.899545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:34.900472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:34.901357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 520/1054] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:34.908037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:34.995544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220af2-e687-47da-b4a5-fdfc6e2e6459 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:34.995834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220af2-e687-47da-b4a5-fdfc6e2e6459 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:34.996116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220af2-e687-47da-b4a5-fdfc6e2e6459 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:34.997467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 521/1055] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:35.002386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.002670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.002943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.015001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda268-e5d7-4d17-95da-ab0d788ba8e3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.023901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:35.025093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:35.058909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.059535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.059854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.060115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.060790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:35.061096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.062552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.073965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 535/1056] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:35.078452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.097950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 522/1057] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:35.120812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.148448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.191511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e8ee-fe0d-4ad5-a639-32da72ed80d9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.217433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.227253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.228094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.228522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.228971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] PATH_INFO: `/v3/users/c351bcadcbba4d0294118cf428b79f92` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.229711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899ded-7f1e-4dac-9443-0fdd9f11e1f3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.247213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] RBAC: Authorizing `identity:get_user(user_id=c351bcadcbba4d0294118cf428b79f92)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.249280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.256671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 536/1058] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/users/c351bcadcbba4d0294118cf428b79f92 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:35.257702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.267769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.268391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.268676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.269318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.342573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.345263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842713b-73eb-4cde-b37e-835c22646f1e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.369040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb138c4-67dd-4bdf-9d7a-d0e85807bc97 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.390038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.406568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.407124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.407410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.407688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.445874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.457181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 523/1059] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 12:39:35.462330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb719-4ded-4dac-81ad-8b2dfe260f22 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.462330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb719-4ded-4dac-81ad-8b2dfe260f22 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.462330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffb719-4ded-4dac-81ad-8b2dfe260f22 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.462330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 524/1060] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:35.465269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffb719-4ded-4dac-81ad-8b2dfe260f22 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.479954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.481418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1dd77-aedd-4d13-9953-d01b1f84a2f0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.566584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffb719-4ded-4dac-81ad-8b2dfe260f22 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.581751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 537/1061] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 12:39:35.583038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.583324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.583597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.601199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:35.602419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:35.607020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.607659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.607942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.608217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.616811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.619295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.620811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:35.636033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:35.637379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 525/1062] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:35.638356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.674076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 538/1063] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:35.674835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.681783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.742786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8cee4-15dd-463e-8efa-356a96ac7bcd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.776705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.777332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.777613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.777923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.778213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee89a3-6687-411f-a8e9-64b6d7ea7f06 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.779068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.780492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.782336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 526/1064] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:35.782929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.815379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.816004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.816290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.816567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.817258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:35.817563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.819529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:35.830780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 539/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:35.831574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.845971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.891107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe540f9c-caf7-451a-b9e5-95424033d283 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.903779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:35.930903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.931476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.931763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.932043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.944448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:35.948726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e2747-e59d-4433-b2f0-cdaad8d060ce None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:35.949672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:35.950872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:35.951944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 527/1066] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:35.960082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:35.993716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:35.994366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:35.994705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:35.994984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:35.995778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=9e7c2820c05f4b958100f9c192da2663, user.id=c351bcadcbba4d0294118cf428b79f92) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:35.996093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:35.997915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.004070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 540/1067] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/role_assignments?user.id=c351bcadcbba4d0294118cf428b79f92&scope.project.id=9e7c2820c05f4b958100f9c192da2663&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:36.092090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934f98-49dd-48bc-aedf-f5594a0a778d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.131530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.132246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.132529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.132804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.133542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:36.133885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.135297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.144672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 528/1068] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:36.150710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:36.226621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:36.252467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f945-6e02-4e77-8272-ead56d4a9f4c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.285115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.285750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.286069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.286344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.296834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.298309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:36.313023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:36.314136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:36.315494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:36.315494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:36.315494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:36.315494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:36.315494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 541/1069] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:36.320726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:36.352426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:36.420348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edcd3b-4768-4e29-a70b-e8087d726038 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.453668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619997f-aae5-414f-80f2-668546714808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.454308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619997f-aae5-414f-80f2-668546714808 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.454589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619997f-aae5-414f-80f2-668546714808 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.454862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619997f-aae5-414f-80f2-668546714808 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.455547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619997f-aae5-414f-80f2-668546714808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:36.455849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619997f-aae5-414f-80f2-668546714808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.457219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619997f-aae5-414f-80f2-668546714808 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.469532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 529/1070] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:36.475789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:36.575976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041536-6528-4bcf-927b-2a9e8e013682 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.601011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:36.609881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.610525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.610813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.611092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.618851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.620281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:36.631812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:36.632796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:36.633773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 542/1071] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:36.638631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619997f-aae5-414f-80f2-668546714808 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:36.728802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:36.738067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619997f-aae5-414f-80f2-668546714808 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.772804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.773415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.773702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.774156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.774951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:36.775259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.776678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.797991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 530/1072] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:36.799085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:36.899027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf5a49-2f2d-4f79-982c-5dae60cda5a2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:36.931972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:36.932658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:36.932945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:36.933222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:36.944071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:36.945559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:36.959623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:36.960526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:36.962142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:36.962142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:36.962142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:36.962142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:36.962142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 543/1073] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:36.966431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:37.067546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c391c2-4be5-4ded-9876-f5f75f2b3004 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:37.103048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:37.103668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:37.103948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:37.104223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:37.104914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:37.105219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:37.106618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:37.118725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 531/1074] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:37.124366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:37.164074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:37.226467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b978-4a16-44e4-989e-7dffa8bf5abe None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:37.260254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:37.260889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:37.261171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:37.261447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:37.268005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:37.269433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:37.280737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:37.281693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:37.282646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 544/1075] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:37.289874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:37.303339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:37.389859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498b04-5eac-49a4-8dbb-e90b3f90f221 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:37.423065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:37.423609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:37.423893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:37.424167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:37.424911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:37.425217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:37.426672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1370faf-db67-4c99-b92e-8ef5bb77501e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:37.439973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 532/1076] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:37.446076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:37.541179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:37.545367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457494c-6a6a-45ee-9bb5-8ec2c00dc5c2 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:37.579175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:37.579845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:37.580131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:37.580412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/c97eba7b60244e0c944b0319fc4a2a31` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:37.582623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=b9dd08e0da964403bf7d7e2b34669efb, role_id=c97eba7b60244e0c944b0319fc4a2a31)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:37.584106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4ca60-a612-48d5-89cc-fd083c5e8f5b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:37.598251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 545/1077] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:37 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/b9dd08e0da964403bf7d7e2b34669efb/roles/c97eba7b60244e0c944b0319fc4a2a31 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:39:37.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a042a-8382-4572-8b88-62d952fd4026 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:37.993249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a042a-8382-4572-8b88-62d952fd4026 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:37.993249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a042a-8382-4572-8b88-62d952fd4026 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:37.994774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 533/1078] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:37.999702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.000084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.000265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.018462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:38.019633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:38.087629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 546/1079] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:38.110217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a042a-8382-4572-8b88-62d952fd4026 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:38.179758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:38.211066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a042a-8382-4572-8b88-62d952fd4026 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:38.245370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:38.245961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.246244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.246517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.256545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:38.261424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:38.262416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:38.263277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 534/1080] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:38.269002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:38.354502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:38.367930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0908e-1bf1-4d31-9b7b-8d44bb2226dc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:38.400599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:38.401211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.401490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.401763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.402501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:38.402804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:38.404159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:38.412491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 547/1081] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:38.418327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:38.516028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c77a-8251-41b6-8fdb-8781bcba00ab None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:38.544594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:38.550660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:38.551300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.551580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.551856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] PATH_INFO: `/v3/users/c351bcadcbba4d0294118cf428b79f92` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.553056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=c351bcadcbba4d0294118cf428b79f92)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:38.554506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:38.556108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 535/1082] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:38 2022] GET /identity/v3/users/c351bcadcbba4d0294118cf428b79f92 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:38.561765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:38.659215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8ad6-5719-456d-a514-5695cdcbbcf7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:38.692722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:38.693975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.694254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.694587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.695731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:38.697164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f04ff-230b-48d6-afdb-ca57725b4174 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:38.698881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 548/1083] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:38 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:38.704819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:38.802272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7c91-60cf-496b-96d2-d94098329dc2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:38.836195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:38.836852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:38.837131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:38.837404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663/users/c351bcadcbba4d0294118cf428b79f92/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:38.839401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7c2820c05f4b958100f9c192da2663, user_id=c351bcadcbba4d0294118cf428b79f92, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:38.840821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ffd32-a9e4-43c1-9e65-379786e02e0d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:38.854148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 536/1084] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:38 2022] PUT /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663/users/c351bcadcbba4d0294118cf428b79f92/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:39:39.595033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ed61-764f-4b62-ade5-db067edb2ff2 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:39.595548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ed61-764f-4b62-ade5-db067edb2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:39.595638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ed61-764f-4b62-ade5-db067edb2ff2 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:39.596941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 549/1085] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:39.602797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:39.603204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:39.603345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:39.622695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:39.623882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:39.674799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:39.690023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 537/1086] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:39.712678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2ed61-764f-4b62-ade5-db067edb2ff2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:39.732149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:39.816177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2ed61-764f-4b62-ade5-db067edb2ff2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:39.848716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:39.849861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:39.850358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:39.850643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:39.861697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:39.867709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:39.868703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:39.869579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 550/1087] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Jul 26 12:39:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:39.874830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:39.974556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56566-0db3-455f-b8f4-c9295f6835bc None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.008931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.009535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.009837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.010113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.010820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:40.011121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.012483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.020235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 538/1088] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:39:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:40.026564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.103227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:40.125064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dbc72-94cb-42f7-b0f8-043dc32b5a5e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.157460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.158115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.158401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.158678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.169080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.170545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:40.185232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:40.186163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:40.187100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:40.187100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:40.187100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:40.187100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:40.187100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 551/1089] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:40.192090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.243913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:40.293633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef749a8-c8b7-41fd-b79f-a7c366fc4f36 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.326413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.327022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.327301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.327571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.328244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:40.328542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.329904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.341433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 539/1090] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:40.346982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.447219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbe32-9b10-4e59-b9bf-6504348466f7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.474683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:40.480912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.481555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.481862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.482143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.489570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.491922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:39:40.502751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:40.503882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:40.504867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 552/1091] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:40.510142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.607704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4883e15-a14d-47bc-b64c-c4e91a11b5d5 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.619211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:40.642692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.643314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.643596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.643870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.644658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:40.644965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.646964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fea0d-0bea-4b16-b786-a6ad1f7c8694 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.664153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 540/1092] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:40.669849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.770111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ea7e-857d-4349-9272-01b416183c34 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:40.804071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:40.804693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.804982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.805261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.834468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275754-bff7-403e-bb26-6d50c45e66d1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.834749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275754-bff7-403e-bb26-6d50c45e66d1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.835041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275754-bff7-403e-bb26-6d50c45e66d1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.836376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 541/1093] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:39:40.841178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:40.841462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:40.841738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:40.859317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:40.860504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:40.863883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:40.876230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:40.877682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:40.928288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 542/1094] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:40.951454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:40.974241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 553/1095] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:40.980753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.047147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.051496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544c96-373b-4cf4-9c83-8f3bd938a9cd None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.073891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.083315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41a0f-af3a-44b4-82b2-adfe9d86d129 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.086942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.087583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.087860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.088133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.098692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:39:41.104385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:41.105507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:39:41.106739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 543/1096] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:41.111490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.121014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.121662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.121981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.122264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.132279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.133725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:39:41.148192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:41.149293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:41.150287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:39:41.150287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:39:41.150287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:39:41.150287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:41.150287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 554/1097] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:39:41.155145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.211262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f8a9-4e49-474e-a0c1-e9bfc5a9f07f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.247570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.248174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.248452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.248723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.249426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:41.249730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.251128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.255299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbac9-ff67-42e7-bdbd-b8d1b5bd0e38 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.259105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 544/1098] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:41.264730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.285935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.289543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.290193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.290475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.290798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.291446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:41.291750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.293113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.305279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 555/1099] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:41.310803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.313362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.364653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3882-dd12-4d60-9bc4-61f7b1ac87b2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.399393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.400033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.400318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.400597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] PATH_INFO: `/v3/users/c351bcadcbba4d0294118cf428b79f92` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.401778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] RBAC: Authorizing `identity:get_user(user_id=c351bcadcbba4d0294118cf428b79f92)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.403227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.404823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 545/1100] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/users/c351bcadcbba4d0294118cf428b79f92 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:41.409818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc151e1-88ce-4b9b-99c3-ef51ad07bee6 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.410402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.444151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.444794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.445075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.445351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.451928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.453373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:39:41.465166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:39:41.466175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:39:41.467477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 556/1101] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:39:41.471971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.498555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.511370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a594d-7656-4893-bc26-403479988db9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.531789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.543912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.544462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.544746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.545022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.570953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ad8d-49d7-4766-b169-6bec626a20dd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.605451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.606106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.606393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.606670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.607419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:41.607727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.609163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.611508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.612939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.621950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 557/1102] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:41.628948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.701396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.714658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 546/1103] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:41.720473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.730445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5c6e-a388-45cd-a5f7-15de0f483179 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.753635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:41.765659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.766361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.766639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.766913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.767701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] RBAC: Adding query filter params (role.id=c97eba7b60244e0c944b0319fc4a2a31, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=b9dd08e0da964403bf7d7e2b34669efb) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:41.768008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.769424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.775174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 558/1104] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/role_assignments?user.id=b9dd08e0da964403bf7d7e2b34669efb&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=c97eba7b60244e0c944b0319fc4a2a31 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:41.822756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4cb8a-db77-4956-b8cb-4bab4cdbb8a0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:41.859114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:41.859771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:41.860050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:41.860323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:41.861533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:41.863018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c152d5-1ce4-4d60-8038-b1e97949f123 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:41.870989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 547/1105] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:39:41.872146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:41.978000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851973-2a7f-44c5-a421-e1dd0f3e3406 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:42.012372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:42.012998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:42.013283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:42.013563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:42.014395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=9e7c2820c05f4b958100f9c192da2663, user.id=c351bcadcbba4d0294118cf428b79f92) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:42.014712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:42.016132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabb90-ef20-4dc1-9ea7-b5e618cbb0c5 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:42.027188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 559/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:41 2022] GET /identity/v3/role_assignments?user.id=c351bcadcbba4d0294118cf428b79f92&scope.project.id=9e7c2820c05f4b958100f9c192da2663&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:44.039183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b879e3-7cac-4377-8b71-80143ea20852 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:44.039712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b879e3-7cac-4377-8b71-80143ea20852 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:44.039712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b879e3-7cac-4377-8b71-80143ea20852 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:44.041059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 548/1107] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:44.046321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:44.046725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:44.046893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:44.064571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:44.065760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:44.110952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:44.132504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 560/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:44.156500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b879e3-7cac-4377-8b71-80143ea20852 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:44.212824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:44.256552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b879e3-7cac-4377-8b71-80143ea20852 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:44.288886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:44.289551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:44.289778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:44.290080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:44.291202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:44.292628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa7d8d-f461-4d78-aed4-7f59df675a1d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:44.294247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 549/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:44.299859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:44.396846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab3c57-e618-4bbe-a3d7-93193ad2b8c8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:44.430192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:44.430800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:44.431084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:44.431358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:44.432042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:44.433463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd07372-172c-4b6f-abf9-b6f304420c1d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:44.456210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 561/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:39:44 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:46.528823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c827b-0499-4721-a78c-d5c9dd967ed0 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:46.529386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c827b-0499-4721-a78c-d5c9dd967ed0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:46.529386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c827b-0499-4721-a78c-d5c9dd967ed0 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:46.530773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 550/1111] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:46.535788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:46.536170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:46.536343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:46.555456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:46.556632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:46.586793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:46.625357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 562/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:46.649530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c827b-0499-4721-a78c-d5c9dd967ed0 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:46.750573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c827b-0499-4721-a78c-d5c9dd967ed0 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:46.774005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:46.784922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:46.785486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:46.785764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:46.786067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] PATH_INFO: `/v3/roles/3b97713662114efa802df415a01374b4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:46.788010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] RBAC: Authorizing `identity:get_role(role_id=3b97713662114efa802df415a01374b4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:46.789374 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:46.790730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 551/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:46 2022] GET /identity/v3/roles/3b97713662114efa802df415a01374b4 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:46.796387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:46.893786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de63bc-c051-4557-b13a-d29a5b841ace None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:46.928063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:46.928683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:46.928967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:46.929239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] PATH_INFO: `/v3/users/a2ccb76cfc5b425eae6afe537a9ae843` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:46.942417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] RBAC: Authorizing `identity:get_user(user_id=a2ccb76cfc5b425eae6afe537a9ae843)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:46.944289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:46.945884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 563/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:46 2022] GET /identity/v3/users/a2ccb76cfc5b425eae6afe537a9ae843 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:46.951490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:47.050090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637525-5683-43e0-9902-6c67d97646ad None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:47.083421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:47.084604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:47.084888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:47.085164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:47.140717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:47.150913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:47.152330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:47.252279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 552/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:47.258245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:47.282407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:47.355023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53d5-edf1-49bd-b963-2879dc39f15b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:47.387995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:47.388621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:47.388899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:47.389173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:47.390334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:47.391750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c6e15-2086-4bf1-92b4-94e2ba5cdbe4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:47.393386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 564/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:47 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:47.400043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:47.486525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:47.496186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a619-91ad-4f17-b08b-bde10355bddb None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:47.528652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:47.529249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:47.529792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:47.529792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:47.530582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=9e7c2820c05f4b958100f9c192da2663, user.id=a2ccb76cfc5b425eae6afe537a9ae843) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:47.530885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:47.532276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3a9fc-19c1-418c-b8a2-efe1eeecf9c4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:47.538254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 553/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:47 2022] GET /identity/v3/role_assignments?user.id=a2ccb76cfc5b425eae6afe537a9ae843&scope.project.id=9e7c2820c05f4b958100f9c192da2663&role.id=3b97713662114efa802df415a01374b4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:49.499985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644275dd-299f-4abf-943b-189effe4aa9b None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:49.500546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644275dd-299f-4abf-943b-189effe4aa9b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:49.500546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644275dd-299f-4abf-943b-189effe4aa9b None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:49.501977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 565/1118] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:49.507657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:49.508091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:49.508217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:49.526493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:49.527682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:49.592917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 554/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:49.615250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644275dd-299f-4abf-943b-189effe4aa9b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:49.705006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:49.715099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644275dd-299f-4abf-943b-189effe4aa9b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:49.748914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:49.749534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:49.749916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:49.750168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] PATH_INFO: `/v3/roles/3b97713662114efa802df415a01374b4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:49.751537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] RBAC: Authorizing `identity:get_role(role_id=3b97713662114efa802df415a01374b4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:49.752879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:49.754231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 566/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:49 2022] GET /identity/v3/roles/3b97713662114efa802df415a01374b4 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:49.760600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:49.842193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:49.857289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743caba-f4be-4747-aadd-ca259fdcad43 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:49.891520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:49.892147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:49.892428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:49.892699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] PATH_INFO: `/v3/users/a2ccb76cfc5b425eae6afe537a9ae843` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:49.893862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] RBAC: Authorizing `identity:get_user(user_id=a2ccb76cfc5b425eae6afe537a9ae843)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:49.895273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:49.896855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 555/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:49 2022] GET /identity/v3/users/a2ccb76cfc5b425eae6afe537a9ae843 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:49.902638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:50.000727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e0664-7ca9-4908-adf0-eb227055f7c9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:50.033259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:50.033936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:50.034223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:50.034505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:50.035662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:50.037695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfda82b-dc0d-4c43-b20e-4fd8428d71b4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:50.039411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 567/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:49 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:50.045268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:50.142086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b851-ea0d-475f-a2ca-b1bac3d6333e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:50.174938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:50.175586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:50.175866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:50.176141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663/users/a2ccb76cfc5b425eae6afe537a9ae843/roles/3b97713662114efa802df415a01374b4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:50.178968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7c2820c05f4b958100f9c192da2663, user_id=a2ccb76cfc5b425eae6afe537a9ae843, role_id=3b97713662114efa802df415a01374b4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:50.180389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3363ca6-7882-4221-ab31-8f738047cb2a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:50.192490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 556/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:39:50 2022] PUT /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663/users/a2ccb76cfc5b425eae6afe537a9ae843/roles/3b97713662114efa802df415a01374b4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:39:52.158248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53b7-f64e-4b8f-85da-cada6e98244b None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:52.158780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53b7-f64e-4b8f-85da-cada6e98244b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:52.158780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53b7-f64e-4b8f-85da-cada6e98244b None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:52.160137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 568/1124] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:52.165288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:52.165685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:52.165873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:52.184033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:52.185210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:52.194825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:52.251978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 557/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:39:52.274512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d53b7-f64e-4b8f-85da-cada6e98244b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:52.304512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:52.381284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d53b7-f64e-4b8f-85da-cada6e98244b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:52.415859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:52.416481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:52.416760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:52.417034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] PATH_INFO: `/v3/roles/3b97713662114efa802df415a01374b4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:52.418476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] RBAC: Authorizing `identity:get_role(role_id=3b97713662114efa802df415a01374b4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:52.419835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:52.421218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 569/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:52 2022] GET /identity/v3/roles/3b97713662114efa802df415a01374b4 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:52.426949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:52.523489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605104-7ec1-45db-b48b-58b529c3c430 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:52.557160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:52.557720 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:52.558029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:52.558303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] PATH_INFO: `/v3/users/a2ccb76cfc5b425eae6afe537a9ae843` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:52.559453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] RBAC: Authorizing `identity:get_user(user_id=a2ccb76cfc5b425eae6afe537a9ae843)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:52.560860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:52.562463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 558/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:39:52 2022] GET /identity/v3/users/a2ccb76cfc5b425eae6afe537a9ae843 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:52.568785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:52.666306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:52.672841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed192b7-5592-43a6-97be-2903b046de7d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:52.707248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:52.707866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:52.708129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:52.709402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:52.776820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:52.778464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:52.870488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:52.877124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 570/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:39:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:39:52.883222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:52.899464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:52.982344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624242-e839-4414-9a70-3aaf33ab364c None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:53.015776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:53.016399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:53.016680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:53.016957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] PATH_INFO: `/v3/projects/9e7c2820c05f4b958100f9c192da2663` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:53.018125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7c2820c05f4b958100f9c192da2663)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:53.019540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be06b9-2a56-459f-b75c-b2aa15790493 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:53.022009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 559/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:39:52 2022] GET /identity/v3/projects/9e7c2820c05f4b958100f9c192da2663 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:53.028044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:53.122924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a61c26-a7c7-4884-a49f-ba5b365027de None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:53.155686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:53.156287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:53.156564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:53.156834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:53.157606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] RBAC: Adding query filter params (role.id=3b97713662114efa802df415a01374b4, scope.project.id=9e7c2820c05f4b958100f9c192da2663, user.id=a2ccb76cfc5b425eae6afe537a9ae843) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:39:53.157943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:53.159350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d391c2-8b1c-47c5-9d0e-39fc366741c2 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:53.164915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 571/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:39:53 2022] GET /identity/v3/role_assignments?user.id=a2ccb76cfc5b425eae6afe537a9ae843&scope.project.id=9e7c2820c05f4b958100f9c192da2663&role.id=3b97713662114efa802df415a01374b4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:55.158463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b9b9-1b48-4c1e-83e1-dfbe72c731d7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:55.159005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b9b9-1b48-4c1e-83e1-dfbe72c731d7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:55.159005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b9b9-1b48-4c1e-83e1-dfbe72c731d7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:55.160339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 560/1131] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:55.165651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:55.166075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:55.166251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:55.184585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:55.185766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:55.239691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:55.252432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 572/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:55.275559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b9b9-1b48-4c1e-83e1-dfbe72c731d7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:55.356393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:55.377425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b9b9-1b48-4c1e-83e1-dfbe72c731d7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:55.410700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:55.411327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:55.411609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:55.412443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:55.413617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:55.415074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dab7f-a3d8-4cf8-af33-fe89b86a4870 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:55.416643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 561/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:55.422493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:55.517451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544db94-2804-4506-9291-5244a4acdd42 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:55.550977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:55.551581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:55.551864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:55.552141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:55.553477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:55.554932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc70dd-1f42-4f0b-b1dd-609a02084105 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:55.580759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 573/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:39:55 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:39:57.702472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e25d-1500-4933-80c1-52671f5be3ba None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:57.703007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e25d-1500-4933-80c1-52671f5be3ba None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:57.703007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e25d-1500-4933-80c1-52671f5be3ba None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:57.704394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 562/1135] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:39:57.710446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:57.710872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:57.711005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:57.728946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:39:57.730164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:39:57.765252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:39:57.798995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 574/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:39:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:39:57.824512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e25d-1500-4933-80c1-52671f5be3ba None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:57.925993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e25d-1500-4933-80c1-52671f5be3ba None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:57.960766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:57.961324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:57.961604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:57.961907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:57.963050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:57.964562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdb03-bbc8-450b-aab6-d50a09ee30ce None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:57.966322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 563/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:39:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:39:57.972101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:39:58.074629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe8500-36ab-4ab9-96a7-2c7466f51950 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:39:58.108062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:39:58.108674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:39:58.108959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:39:58.109240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:39:58.109959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:39:58.111390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8961b1-97be-44c3-92b6-62ae7b4887da None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:39:58.131796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 575/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:39:57 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:40:00.148601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8922f-f64c-4bec-8d87-b47c9f602928 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.149116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8922f-f64c-4bec-8d87-b47c9f602928 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.149116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8922f-f64c-4bec-8d87-b47c9f602928 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.150515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 564/1139] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:00.155652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.156058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.156223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.175102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:00.176289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:00.198799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:00.243740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 576/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:40:00.265983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8922f-f64c-4bec-8d87-b47c9f602928 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:00.284340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:00.366587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8922f-f64c-4bec-8d87-b47c9f602928 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:00.400125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:00.400752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.401033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.401307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.411131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:00.416068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:00.417766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:00.419054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 565/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:00.423713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:00.519703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc609e-343f-4f1e-a6f4-aff607c10531 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:00.552600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:00.553211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.553492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.553769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.554513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:00.554821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:00.556180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:00.564020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 577/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:00.570267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:00.645414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:00.668305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848d6a-47ff-4868-98f9-7260959bdc8d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:00.701425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:00.702080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.702366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.702641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] PATH_INFO: `/v3/users/0ee41e1936a348b4bd25951acaf353a6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.716281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] RBAC: Authorizing `identity:get_user(user_id=0ee41e1936a348b4bd25951acaf353a6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:00.717696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:00.719324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 566/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:00 2022] GET /identity/v3/users/0ee41e1936a348b4bd25951acaf353a6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:00.725818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:00.748414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:00.824968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da3e-0061-4b2a-93f9-dffb43c189b1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:00.857667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:00.858297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:00.858578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:00.858850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:00.924230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:00.925591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:00.946430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:01.022578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 578/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:40:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:40:01.028607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:01.127246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e197-82bb-466b-8957-4ecc3a525757 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:01.160065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:01.160690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:01.160969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:01.161241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] PATH_INFO: `/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:01.162437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] RBAC: Authorizing `identity:get_project(project_id=67c715d6e7dd482ea2f372cb9b9a3a18)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:01.163848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ca35-56eb-425c-a12b-148c5f72ae58 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:01.165478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 567/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:01 2022] GET /identity/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:01.171574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:01.267930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741b25-689b-4bac-b220-a9cdd7a2ef6d None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:01.287893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:01.302113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:01.303271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:01.303557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:01.303836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:01.304624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=67c715d6e7dd482ea2f372cb9b9a3a18, user.id=0ee41e1936a348b4bd25951acaf353a6) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:01.304947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:01.306619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eabf18-4255-4a7f-9322-3c3481b915b0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:01.311933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 579/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:40:01 2022] GET /identity/v3/role_assignments?user.id=0ee41e1936a348b4bd25951acaf353a6&scope.project.id=67c715d6e7dd482ea2f372cb9b9a3a18&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:03.280114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264399b-ed4a-4c54-9f6b-4629e04ae9af None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.280660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264399b-ed4a-4c54-9f6b-4629e04ae9af None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.280660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264399b-ed4a-4c54-9f6b-4629e04ae9af None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.282063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 568/1147] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:03.287373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.287775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.287933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.306369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:03.307475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:03.373514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 580/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:03.395926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264399b-ed4a-4c54-9f6b-4629e04ae9af None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:03.398829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:03.497023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264399b-ed4a-4c54-9f6b-4629e04ae9af None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:03.529604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:03.530257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.530541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.530818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.541169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:03.546129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:03.547253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:03.548446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 569/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:03.553223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:03.649312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e32a4-0488-4d0a-bcd4-2d423b9d1c9b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:03.663203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:03.683533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:03.684143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.684427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.684705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.685417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:03.685724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:03.687115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:03.695154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 581/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:03.700926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:03.762440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:03.801225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd701-304d-4b8e-a65c-7d8e64201d89 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:03.835487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:03.836106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.836386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.836663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] PATH_INFO: `/v3/users/0ee41e1936a348b4bd25951acaf353a6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.837799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] RBAC: Authorizing `identity:get_user(user_id=0ee41e1936a348b4bd25951acaf353a6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:03.839238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:03.840812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 570/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:03 2022] GET /identity/v3/users/0ee41e1936a348b4bd25951acaf353a6 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:03.846578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:03.944345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20aeaf-4528-4805-9fbc-5371a1c9a8f0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:03.976301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:03.976921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:03.977204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:03.977482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] PATH_INFO: `/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:03.978663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] RBAC: Authorizing `identity:get_project(project_id=67c715d6e7dd482ea2f372cb9b9a3a18)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:03.980082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a145a78-95dd-4828-87df-35037da9a246 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:03.981729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 582/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:03 2022] GET /identity/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:03.987652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:04.089797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dbccb-3439-432b-9652-fc61cbecab35 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:04.117892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:04.123772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:04.124431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:04.124713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:04.124989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] PATH_INFO: `/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18/users/0ee41e1936a348b4bd25951acaf353a6/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:04.126907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] RBAC: Authorizing `identity:create_grant(project_id=67c715d6e7dd482ea2f372cb9b9a3a18, user_id=0ee41e1936a348b4bd25951acaf353a6, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:04.128328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725f2f8-b95c-4c15-8a2d-92ea1a0a60ac None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:04.141072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 571/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:40:03 2022] PUT /identity/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18/users/0ee41e1936a348b4bd25951acaf353a6/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:40:06.093462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7de7-d4f3-4235-9877-9245e6d0de0c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.093979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7de7-d4f3-4235-9877-9245e6d0de0c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.094105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7de7-d4f3-4235-9877-9245e6d0de0c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.095395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 583/1154] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:06.100530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.100920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.101086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.119680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:06.120857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:06.184903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 572/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:06.208328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7de7-d4f3-4235-9877-9245e6d0de0c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:06.254409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:06.308785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7de7-d4f3-4235-9877-9245e6d0de0c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:06.341632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:06.342290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.342575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.342854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.353269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:06.358160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:06.359275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:40:06.360203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 584/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:06.366033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:06.462866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87fc30-848a-4ddc-967f-71bab557753d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:06.482608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:06.498137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:06.498745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.499029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.499312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.500024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:06.500331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:06.501689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:06.509651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 573/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:06.515303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:06.613748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20bf5b-c923-4ab3-b0a4-6a6f7702b1ec None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:06.616714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:06.647546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:06.648172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.648456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.648733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] PATH_INFO: `/v3/users/0ee41e1936a348b4bd25951acaf353a6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.649892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] RBAC: Authorizing `identity:get_user(user_id=0ee41e1936a348b4bd25951acaf353a6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:06.651405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:06.652986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 585/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:06 2022] GET /identity/v3/users/0ee41e1936a348b4bd25951acaf353a6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:06.658696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:06.757415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d9d5-f4f3-4354-92d3-2662eef82260 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:06.790498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:06.791103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:06.791385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:06.791661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:06.841513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:06.860183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:06.861646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:06.957459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 574/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:40:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:40:06.964060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:07.061354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7192-50b3-46ae-b1b8-ba91bca2ea11 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:07.093406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:07.094066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:07.094589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:07.094589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] PATH_INFO: `/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:07.095725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] RBAC: Authorizing `identity:get_project(project_id=67c715d6e7dd482ea2f372cb9b9a3a18)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:07.097199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046cd82-79e4-41af-93e7-33520f30c04e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:07.098871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 586/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:06 2022] GET /identity/v3/projects/67c715d6e7dd482ea2f372cb9b9a3a18 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:07.105543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:07.185070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:07.203581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472b194-4070-41e4-be62-df6230771c5e None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:07.237019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:07.237562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:07.237867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:07.238148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:07.238927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=67c715d6e7dd482ea2f372cb9b9a3a18, user.id=0ee41e1936a348b4bd25951acaf353a6) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:07.239236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:07.241281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249710b-ccdb-476b-bd96-d666153565da None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:07.247264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 575/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:40:07 2022] GET /identity/v3/role_assignments?user.id=0ee41e1936a348b4bd25951acaf353a6&scope.project.id=67c715d6e7dd482ea2f372cb9b9a3a18&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:40:09.256455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2618b9-ccab-4dcd-b69e-0b57a15f5fa4 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:09.257007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2618b9-ccab-4dcd-b69e-0b57a15f5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:09.257007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2618b9-ccab-4dcd-b69e-0b57a15f5fa4 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:09.258381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 587/1162] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:09.263411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:09.263850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:09.263944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:09.281612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:09.282833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:09.346704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 576/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:09.368691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2618b9-ccab-4dcd-b69e-0b57a15f5fa4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:09.410915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:09.467694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2618b9-ccab-4dcd-b69e-0b57a15f5fa4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:09.500519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:09.501117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:09.501394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:09.501665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:09.565939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:09.567366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:09.605878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:09.663289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 588/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:40:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:40:09.669516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:09.744259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:09.767080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e92ed-758b-4c0b-aca7-ac990887695e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:09.800256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:09.800890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:09.801173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:09.801450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:09.808801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:09.810268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-27b6d65d-56f0-4665-8528-22e4bbb11050 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:09.821627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:09.822902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:09.823987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 577/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:40:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:09.828737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:09.932641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abf59-0bd9-497d-8dfe-9308a6da2564 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:09.965161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:09.965770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:09.966083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:09.966361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:09.967045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:09.967372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:09.968733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28199a-88c2-4ed1-a642-9e81d8f075aa None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:09.976354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 589/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Jul 26 12:40:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:11.947116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238c1b-f02c-4484-bf11-63b0203c65ae None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:11.947654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238c1b-f02c-4484-bf11-63b0203c65ae None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:11.947654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238c1b-f02c-4484-bf11-63b0203c65ae None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:11.949018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 578/1167] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:11.954189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48207-7f36-4d4d-8e0f-e43cb172d6d1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:11.954597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48207-7f36-4d4d-8e0f-e43cb172d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:11.954748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48207-7f36-4d4d-8e0f-e43cb172d6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:11.962638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:11.973599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-23c48207-7f36-4d4d-8e0f-e43cb172d6d1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:11.974884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-23c48207-7f36-4d4d-8e0f-e43cb172d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:12.039162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 590/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:12.061052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238c1b-f02c-4484-bf11-63b0203c65ae None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:12.167058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238c1b-f02c-4484-bf11-63b0203c65ae None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:12.201043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:12.201583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:12.201890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:12.202168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:12.202881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:12.204228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d0f6-5ac2-43c6-b32e-78406b544c96 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:12.208846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:12.221458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 579/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Tue Jul 26 12:40:12 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:40:14.226501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996b3d-4761-452c-9c81-6f49d7d0b445 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:14.227026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996b3d-4761-452c-9c81-6f49d7d0b445 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:14.227146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996b3d-4761-452c-9c81-6f49d7d0b445 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:14.228399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 591/1170] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:14.233732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:14.234140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:14.234388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:14.252976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:14.254193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:14.319241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 580/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:14.341631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3996b3d-4761-452c-9c81-6f49d7d0b445 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:14.439289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3996b3d-4761-452c-9c81-6f49d7d0b445 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:14.471603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:14.472218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:14.472498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:14.472771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] PATH_INFO: `/v3/domains/9ce7f903ca524ce4af12350374836e43` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:14.474785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:14.483892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] RBAC: Authorizing `identity:get_domain(domain_id=9ce7f903ca524ce4af12350374836e43)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:14.485323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6904-24aa-4f1e-8813-40fa285ba07e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:14.486934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 592/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Tue Jul 26 12:40:14 2022] GET /identity/v3/domains/9ce7f903ca524ce4af12350374836e43 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:14.493768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:14.599987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a252328-814f-42ab-bf8c-485d316a4485 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:14.625613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:14.635506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:14.636110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:14.636390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:14.636662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:14.637344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:14.638795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ecb5e-93ca-4809-b30d-cfe3c574997d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:14.665150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 581/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:40:14 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:40:16.666933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccafb-8a7a-473e-b2d8-41cd01a4ad41 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:16.667567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccafb-8a7a-473e-b2d8-41cd01a4ad41 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:16.667567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccafb-8a7a-473e-b2d8-41cd01a4ad41 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:16.668833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 593/1174] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:16.673896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:16.674317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:16.674454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:16.692196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:16.693754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:16.758864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 582/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:16.783131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccafb-8a7a-473e-b2d8-41cd01a4ad41 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:16.882623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccafb-8a7a-473e-b2d8-41cd01a4ad41 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:16.915349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:16.915969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:16.916246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:16.916519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] PATH_INFO: `/v3/domains/9ce7f903ca524ce4af12350374836e43` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:16.917696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9ce7f903ca524ce4af12350374836e43)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:16.919090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebcf9-12db-4db2-ab01-2b73e5dc9a47 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:16.920632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 594/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Tue Jul 26 12:40:16 2022] GET /identity/v3/domains/9ce7f903ca524ce4af12350374836e43 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:16.926395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:17.022975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52055a2-505a-4737-811b-63c0b3cdd11a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:17.032126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:17.058889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:17.059500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:17.059781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:17.060055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:17.060731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:17.062180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82ed2-58e7-46c6-9e97-f3b371fe1b61 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:17.081342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 583/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:40:16 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:40:19.100233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f27a9-7cc5-438b-9cef-ded4433c7fca None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.100750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f27a9-7cc5-438b-9cef-ded4433c7fca None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.100856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f27a9-7cc5-438b-9cef-ded4433c7fca None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.102174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 595/1178] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:19.107181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.107625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.107739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.126069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:19.127260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:19.192687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 584/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:19.215540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f27a9-7cc5-438b-9cef-ded4433c7fca None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:19.276712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:19.315426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f27a9-7cc5-438b-9cef-ded4433c7fca None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:19.348841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:19.350029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.350318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.350594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.360811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:19.366171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:19.367616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:40:19.368755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 596/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:19.373588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:19.462458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:19.469931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5be21c-00be-49b0-9a86-3da6abcda2b5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:19.503157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:19.503762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.504046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.504322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.505521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:19.506254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:19.507241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:19.515135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 585/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:19.521401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:19.618770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8634-949f-454b-901c-001923fcd398 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:19.640708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:19.652095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:19.652717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.652997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.653270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] PATH_INFO: `/v3/users/42662eda19114ebcbef1d8ef3debf6a8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.666103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=42662eda19114ebcbef1d8ef3debf6a8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:19.667523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:19.669094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 597/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:19 2022] GET /identity/v3/users/42662eda19114ebcbef1d8ef3debf6a8 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:19.674832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:19.772753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41231c-5f55-4ac9-b71d-9c141a2c64b4 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:19.807343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:19.807950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:19.808230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:19.808503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:19.833801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:19.876217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:19.877605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:19.974946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 586/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:40:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:40:19.980753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:20.078054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba7faa-d05d-466b-a663-895180195bc7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:20.110747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:20.111375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:20.111659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:20.111936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] PATH_INFO: `/v3/projects/8d83a6b98f104a619d9d4ce714594869` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:20.113083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] RBAC: Authorizing `identity:get_project(project_id=8d83a6b98f104a619d9d4ce714594869)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:20.115081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db79e-9759-42a9-9f93-f58ec85eb31a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:20.116721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 598/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:19 2022] GET /identity/v3/projects/8d83a6b98f104a619d9d4ce714594869 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:20.123082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:20.177701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:20.220659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ba4a-fbb4-44ef-adfc-da38346d755a None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:20.255837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:20.256470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:20.256755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:20.257032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:20.257836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=8d83a6b98f104a619d9d4ce714594869, user.id=42662eda19114ebcbef1d8ef3debf6a8) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:20.258152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:20.259565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d836-862e-473d-92cf-fc857a17498f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:20.264902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 587/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:40:20 2022] GET /identity/v3/role_assignments?user.id=42662eda19114ebcbef1d8ef3debf6a8&scope.project.id=8d83a6b98f104a619d9d4ce714594869&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:22.235044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9becb33-7f77-43d3-aa0d-125adf3b5285 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.235592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9becb33-7f77-43d3-aa0d-125adf3b5285 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.235592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9becb33-7f77-43d3-aa0d-125adf3b5285 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.236945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 599/1186] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:22.242660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.243089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.243214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.261330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:22.262541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:22.326842 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 588/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:40:22.349142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9becb33-7f77-43d3-aa0d-125adf3b5285 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:22.399249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:22.449409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9becb33-7f77-43d3-aa0d-125adf3b5285 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:22.481670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:22.482318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.482599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.482871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.493327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:22.498156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:22.499275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:40:22.500508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 600/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:22.505276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:22.553830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:22.603366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf366-fa09-4b56-b051-62ea3034742e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:22.635743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:22.636346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.636627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.636902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.637609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:22.637940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:22.639287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:22.647724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 589/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:22.653483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:22.750976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b428-2853-4d4f-96e6-989831d4b7db None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:22.759909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:22.784739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:22.785359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.785642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.785951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] PATH_INFO: `/v3/users/42662eda19114ebcbef1d8ef3debf6a8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.787683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] RBAC: Authorizing `identity:get_user(user_id=42662eda19114ebcbef1d8ef3debf6a8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:22.789100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:22.790699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 601/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:22 2022] GET /identity/v3/users/42662eda19114ebcbef1d8ef3debf6a8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:22.796475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:22.894472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba18a8-639b-4b21-b63a-b379218fe271 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:22.906723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:22.928009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:22.928630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:22.928909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:22.929185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] PATH_INFO: `/v3/projects/8d83a6b98f104a619d9d4ce714594869` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:22.930347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] RBAC: Authorizing `identity:get_project(project_id=8d83a6b98f104a619d9d4ce714594869)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:22.931761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969d673-bee7-410f-90c4-45d350c8e68e None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:22.933397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 590/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:22 2022] GET /identity/v3/projects/8d83a6b98f104a619d9d4ce714594869 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:22.939310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:23.035724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8f5e6-3fe0-4c56-9ecc-322a23b03fad None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:23.069692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:23.070373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:23.070653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:23.070926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] PATH_INFO: `/v3/projects/8d83a6b98f104a619d9d4ce714594869/users/42662eda19114ebcbef1d8ef3debf6a8/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:23.072810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d83a6b98f104a619d9d4ce714594869, user_id=42662eda19114ebcbef1d8ef3debf6a8, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:23.074262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5897da-7b49-4a99-9244-2b0ed2ecdd89 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:23.086639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 602/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:40:22 2022] PUT /identity/v3/projects/8d83a6b98f104a619d9d4ce714594869/users/42662eda19114ebcbef1d8ef3debf6a8/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:40:25.048761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e00af-1820-4d40-831e-b2c916c847a9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.049247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e00af-1820-4d40-831e-b2c916c847a9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.049342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e00af-1820-4d40-831e-b2c916c847a9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.050689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 591/1193] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:40:25.056235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.056648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.056762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.074772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:40:25.075939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:40:25.103473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:25.141967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 603/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:40:25.164629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e00af-1820-4d40-831e-b2c916c847a9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:25.264410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e00af-1820-4d40-831e-b2c916c847a9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:25.296660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:25.297211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.297489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.297759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.308045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:40:25.312909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:40:25.314067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:40:25.315422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 592/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:40:25.320610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:25.415882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bd472-41c2-40ec-a831-a4caed81c937 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:25.448579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:25.449178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.449459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.449734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.450467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:25.450770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:25.452118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:25.460367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 604/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:25.466030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:25.507970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:25.564339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d33e-2dc0-481c-a1ff-35befd27f7d1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:25.596567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:25.597190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.597477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.597750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] PATH_INFO: `/v3/users/42662eda19114ebcbef1d8ef3debf6a8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.598997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] RBAC: Authorizing `identity:get_user(user_id=42662eda19114ebcbef1d8ef3debf6a8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:25.600405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:25.601993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 593/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Jul 26 12:40:25 2022] GET /identity/v3/users/42662eda19114ebcbef1d8ef3debf6a8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:25.607702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:25.637262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:25.707482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138133c-f17d-447b-80d6-4fd84a2f0bbd None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:25.740313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:25.740922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:25.741211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:25.741489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:25.806832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:25.808297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:25.834443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:25.904520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 605/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:40:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:40:25.910395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:26.010044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ccf8-d8ec-49db-949c-b0f5f9d0cb08 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:26.018499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:26.046467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:26.047105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:26.047380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:26.047648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] PATH_INFO: `/v3/projects/8d83a6b98f104a619d9d4ce714594869` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:26.048810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] RBAC: Authorizing `identity:get_project(project_id=8d83a6b98f104a619d9d4ce714594869)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:26.050262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbb62d-1576-426d-ac29-5a1cd34ed052 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:26.051908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 594/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Jul 26 12:40:25 2022] GET /identity/v3/projects/8d83a6b98f104a619d9d4ce714594869 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:26.058030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:40:26.155137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2478d1-7014-4d7c-91a2-e90233199fad None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:40:26.180183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:26.188017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:40:26.188621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:40:26.188902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:40:26.189178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:40:26.189987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=8d83a6b98f104a619d9d4ce714594869, user.id=42662eda19114ebcbef1d8ef3debf6a8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:40:26.190302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:40:26.191721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7956-7db6-4dea-bf23-a80e85cf7069 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:40:26.198007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 606/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:40:26 2022] GET /identity/v3/role_assignments?user.id=42662eda19114ebcbef1d8ef3debf6a8&scope.project.id=8d83a6b98f104a619d9d4ce714594869&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:40:36.042291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=12 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:40:36.195431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:21.160288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0187-9f66-4d53-a39c-f7b55a3b541e None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:21.160957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0187-9f66-4d53-a39c-f7b55a3b541e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:21.160957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0187-9f66-4d53-a39c-f7b55a3b541e None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:21.162570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 595/1201] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:21.168257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:21.168736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:21.168837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:21.193216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:21.194747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:21.290985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 607/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:41:21.314889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0187-9f66-4d53-a39c-f7b55a3b541e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:21.449148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0187-9f66-4d53-a39c-f7b55a3b541e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:21.503438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:21.504800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:21.505242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:21.505667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:21.518816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:21.522029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:21.539502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:21.540769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:21.542195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:21.542195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:21.542195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:21.542195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:21.542195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 596/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:21.547121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:21.673383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1245e6-837d-4842-a725-c4615be1b8d3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:21.710732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:21.718144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:21.718794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:21.719082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:21.719363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:21.720402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:21.720787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:21.722479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c327f5-101c-4e75-84bd-863e2b55525c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:21.739392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 608/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:21.745618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:21.845196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:21.916143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956a18a-2fd6-4b9e-887a-6f3983aaf752 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:21.959329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:21.960062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:21.960377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:21.960688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:21.961392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:21.963002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591fb0b-3c03-47b7-a07f-4597fa05b638 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:21.995570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 597/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Jul 26 12:41:21 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:41:24.560969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008f7b-f024-46f8-9bf6-6d5eba6ebfaa None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:24.561519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008f7b-f024-46f8-9bf6-6d5eba6ebfaa None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:24.561519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008f7b-f024-46f8-9bf6-6d5eba6ebfaa None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:24.563576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 609/1206] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:24.570425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:24.570887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:24.571017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:24.592794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:24.594156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:24.682290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 598/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:24.706172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008f7b-f024-46f8-9bf6-6d5eba6ebfaa None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:24.830906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008f7b-f024-46f8-9bf6-6d5eba6ebfaa None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:24.867037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:24.867695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:24.867998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:24.868532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:24.881128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:24.886114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:24.887118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:24.887996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 610/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:41:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:24.893309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:24.935832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:25.004466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f105d-3da5-4821-b172-9eb7e6c3986f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:25.049442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:25.050117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:25.050960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:25.051448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:25.052177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:25.052482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:25.054576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:25.064399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 599/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:41:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:25.070965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:25.126273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:25.194340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9ed5a-b1b2-4998-af1b-ff90bf4c671e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:25.255781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:25.260077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:25.260514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:25.260836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:25.277841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:25.279669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:25.295916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:25.297095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:25.298269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:25.298269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:25.298269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:25.298269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:25.298951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 611/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:25.305420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:25.423857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:25.428713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e343c-831e-439a-a158-29b4cab23279 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:25.474555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:25.475284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:25.475633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:25.475985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:25.476745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:25.477111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:25.478568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:25.493841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 600/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:25.499842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:25.633857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ba695-6c53-4724-949d-fd9b8b2c1a58 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:25.635417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:25.678661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:25.679235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:25.679515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:25.679797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:25.689756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:25.692118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:25.705914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:25.707527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:25.708545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:25.713174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 612/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:25.715081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:25.849515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ad15-3d97-4208-a1eb-4b0f4982d594 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:25.896826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:25.897454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:25.897738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:25.898042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:25.898833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:25.899137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:25.901741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:25.927656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 601/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:25.929570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:26.057245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2492-66d6-4c85-8b5d-1522913b31e0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:26.101087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:26.102034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:26.102443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:26.103089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:26.141046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:26.190226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:26.192894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:26.309344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 613/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:41:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:41:26.314764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:26.336016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:26.445547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd67e-9818-410f-b6f4-4cb7687a0969 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:26.486565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:26.487280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:26.487597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:26.487896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:26.502782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:26.504307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:26.521207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:26.522493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:26.523411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:26.523411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:26.523411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:26.523411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:26.523411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 602/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:26.528879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:26.601859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:26.649594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbe18-bdfa-43c8-86e0-9dec0a7c0ef0 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:26.687751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:26.688654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:26.689084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:26.689467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:26.690316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:26.690730 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:26.692374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:26.705965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 614/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:26.711198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:26.791622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:26.828105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf719-6663-4475-bd9c-5679c4df27ce None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:26.872728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:26.873373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:26.873649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:26.873949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:26.881798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:26.883376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:26.899126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:26.905208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:26.906412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 603/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:26.907521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:27.028255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09854c-2228-4cf7-99ef-3e02ad4c36ba None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:27.060810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:27.075658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:27.076502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:27.076894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:27.077218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:27.078136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:27.078479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:27.080303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fbd19-024b-4441-8e34-23ff3b97a38d None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:27.097523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 615/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:27.104316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:27.215765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f527-a405-4f24-a350-5b0aa547edee None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:27.251336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:27.258602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:27.259393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:27.259656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:27.259958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:27.260730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=3fbdfe23df8c4200ac0d437c075942d8) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:27.261052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:27.262519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146b97c-b6a9-4e8e-82cd-69d28326472d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:27.268300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 604/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:41:27 2022] GET /identity/v3/role_assignments?user.id=3fbdfe23df8c4200ac0d437c075942d8&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:29.276166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a64d-5e00-4f35-8ffd-f93444d8f8d2 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:29.276715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a64d-5e00-4f35-8ffd-f93444d8f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:29.276715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a64d-5e00-4f35-8ffd-f93444d8f8d2 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:29.278114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 616/1220] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:29.284196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:29.284698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:29.284880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:29.307496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:29.308900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:29.382140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 605/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:29.404252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836a64d-5e00-4f35-8ffd-f93444d8f8d2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:29.511199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836a64d-5e00-4f35-8ffd-f93444d8f8d2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:29.547594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:29.548230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:29.548505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:29.548819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:29.559449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:29.564240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:29.565406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:29.566396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 617/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:41:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:29.572090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:29.690764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5509d-bd59-4dd4-8988-565f08e3f889 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:29.720714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:29.732818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:29.733537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:29.733827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:29.734121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:29.734852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] RBAC: Adding query filter params (name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:29.735150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:29.736494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:29.745407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 606/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:41:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:29.751342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:29.798994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:29.873726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6b07-bc1b-466d-b011-a0ab7ba744f9 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:29.913024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:29.913671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:29.914002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:29.914285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:29.924813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:29.926811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:29.942763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:29.943923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:29.951253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:29.951253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:29.951253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:29.951253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:29.951253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 618/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:29.951590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.089828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715d44-94a6-41f8-b7d7-590b9560905f None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:30.137208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:30.137855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:30.138198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:30.138531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:30.139727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:30.140254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:30.142666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:30.158765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 607/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:30.166911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.280386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:30.293362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044464f0-6f3f-4142-a11a-920c0fd4db0c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:30.330746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:30.331399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:30.332209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:30.332493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:30.341095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:30.342806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:30.355268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:30.356235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:30.357220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 619/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:30.362492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.419797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:30.479231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7b0f-8110-46e8-b2e5-53740688f4a2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:30.517538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:30.518269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:30.518550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:30.518829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:30.520585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:30.520964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:30.522608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:30.541436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 608/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:30.547394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.663874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9aaeb-3e01-4d5e-a832-cad767b70a34 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:30.705034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:30.705649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:30.705927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:30.706181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:30.719344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:30.721051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:30.736293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:30.737303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:30.738341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:30.738341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:30.738341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:30.738341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:30.738341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 620/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:30.744305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.873073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8973ab-00ba-4af5-bec1-a5ba93ab80f9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:30.875963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:30.913033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:30.913682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:30.914026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:30.914368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:30.915194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:30.915500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:30.916869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:30.930603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 609/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:30.938192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:30.952469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:31.056585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f5ab-b56d-4c0d-96bf-6c07792447b7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:31.097477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:31.098275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:31.098548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:31.098960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:31.107593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:31.109329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:31.123719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:31.124695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:31.125679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 621/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:31.132205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:31.244468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cd8f8-70d4-4b1f-896d-0414144f7f46 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:31.281961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:31.282579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:31.282859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:31.283129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:31.284034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:31.284355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:31.286850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e251-9c9d-4cd7-a27b-e72faa9d1744 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:31.301885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 610/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:31.307885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:31.383938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:31.423206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086823-712a-423a-acf9-3f03a08335a7 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:31.457422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:31.458156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:31.458486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:31.458690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/3fbdfe23df8c4200ac0d437c075942d8/roles/517fb894345c440f820c4bc53590b7f6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:31.474622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=3fbdfe23df8c4200ac0d437c075942d8, role_id=517fb894345c440f820c4bc53590b7f6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:31.476291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33d216-f8e5-4bac-8b64-2f472f02fe03 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:31.489259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 622/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:41:31 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/3fbdfe23df8c4200ac0d437c075942d8/roles/517fb894345c440f820c4bc53590b7f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:41:33.568417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162d6f-beae-41ec-9394-f05f845769c9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:33.569027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162d6f-beae-41ec-9394-f05f845769c9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:33.569132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162d6f-beae-41ec-9394-f05f845769c9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:33.570865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 611/1233] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:33.579962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:33.580531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:33.580794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:33.602111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:33.603385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:33.680020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 623/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:33.704669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21162d6f-beae-41ec-9394-f05f845769c9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:33.736679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:33.834110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21162d6f-beae-41ec-9394-f05f845769c9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:33.875135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:33.875773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:33.876175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:33.876486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:33.888568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:33.893550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:33.894747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:33.895802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 612/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Jul 26 12:41:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:33.903117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:33.954549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:34.018095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845829ac-6973-4c23-9bd2-fbdce920af7d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.055165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.055949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.056232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.056696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:34.057546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] RBAC: Adding query filter params (name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:34.057880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:34.059721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:34.069996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 624/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Jul 26 12:41:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:34.076157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:34.174430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:34.192029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc773a0-7ecc-4b64-bafb-edf1cf6669d2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.228731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.229457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.229833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.230153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:34.240848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:34.242354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:34.257727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:34.258893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:34.264667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:34.264667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:34.264667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:34.264667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:34.264667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 613/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:34.265584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:34.377977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5683-e48b-43d3-b3a2-d4635dbc950f None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.388980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:34.417157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.417856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.418166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.418445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:34.419215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:34.419534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:34.421079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:34.435195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 625/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:34.441614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:34.549533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95becb88-addc-4e8f-9265-5f2592d79422 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.589246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.590065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.590393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.590715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:34.594274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:34.600302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:34.602015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:34.615492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:34.616811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:34.618795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 614/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:34.624272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:34.738994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55a87-2a99-41d7-884e-f3fa7084d317 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.778564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.779423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.779797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.780117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:34.781312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:34.781754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:34.783470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:34.811310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 626/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:34.812557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:34.934106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dfbd3-3524-4cfc-9944-9c5d32dcebdd None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:34.970189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:34.970815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:34.971097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:34.971371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:35.045672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:35.053593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:35.055220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:35.178454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 615/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:41:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:41:35.185126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:35.217141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:35.306206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb595-e60f-4b70-9fe6-692630279e87 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:35.344457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:35.345165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:35.345500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:35.345780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:35.357698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:35.359191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:35.374775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:35.375833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:35.376799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:35.376799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:35.376799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:35.376799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:35.376799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 627/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:35.382884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:35.485959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:35.493202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980abd00-2074-4692-8fb3-e3841a954b1d None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:35.532620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:35.533453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:35.533739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:35.534046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:35.535345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:35.535812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:35.537738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:35.553426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 616/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:35.559258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:35.650169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:35.679209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade44ab-8d26-411d-adfa-217756c0bb92 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:35.717406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:35.718187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:35.718480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:35.718825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:35.726748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:35.728305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:35.741373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:35.742541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:35.743847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 628/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:35.748730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:35.870891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63004388-c904-4e27-81f5-e3b537bfa0d2 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:35.913789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:35.914609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:35.915071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:35.915371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:35.916350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:35.916661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:35.918137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894067d-b59e-4e8d-b1d3-fa81ad29fa41 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:35.932415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 617/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:35.938753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:36.053944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283692-11cb-4804-9382-523fbc1d3b4b None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:36.094267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:36.094923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:36.095209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:36.095489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:36.096447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] RBAC: Adding query filter params (role.id=517fb894345c440f820c4bc53590b7f6, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=3fbdfe23df8c4200ac0d437c075942d8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:36.096760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:36.098439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a18d-7923-4739-bd9e-ada36e331e1a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:36.105315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 629/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:41:35 2022] GET /identity/v3/role_assignments?user.id=3fbdfe23df8c4200ac0d437c075942d8&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=517fb894345c440f820c4bc53590b7f6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:38.416415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb80d5-fc4e-4488-b3ea-1bdb0f9a1dae None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:38.417037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb80d5-fc4e-4488-b3ea-1bdb0f9a1dae None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:38.417037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb80d5-fc4e-4488-b3ea-1bdb0f9a1dae None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:38.418414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 618/1247] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:38.423653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0405c-3509-41dc-9efd-153480306efa None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:38.424116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0405c-3509-41dc-9efd-153480306efa None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:38.424211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0405c-3509-41dc-9efd-153480306efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:38.431890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:38.446109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-48f0405c-3509-41dc-9efd-153480306efa None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:38.447437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-48f0405c-3509-41dc-9efd-153480306efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:38.522469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 630/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:38.547586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb80d5-fc4e-4488-b3ea-1bdb0f9a1dae None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:38.569851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:38.660768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb80d5-fc4e-4488-b3ea-1bdb0f9a1dae None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:38.696007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:38.696544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:38.696829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:38.697145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:38.708356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:38.713304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:38.714551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:38.715688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 619/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:38.720637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0405c-3509-41dc-9efd-153480306efa None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:38.831320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0405c-3509-41dc-9efd-153480306efa None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:38.870221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:38.875939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:38.876567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:38.876858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:38.877119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:38.877842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:38.878172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:38.880505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:38.890269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 631/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:38.896684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:38.983068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:39.017952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7949d9-9366-4172-b1aa-bcc736b15ad0 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:39.059578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:39.060230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:39.060518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:39.060836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:39.071079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:39.072533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:39.087607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:39.088622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:39.089545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:39.089545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:39.089545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:39.089545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:39.089545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 620/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:39.094552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:39.209037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4f13d-6f93-4cbd-aed3-b91ed3e05e04 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:39.248267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:39.248817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:39.249102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:39.249383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:39.250128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:39.250440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:39.251847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:39.266035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 632/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:39.272686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:39.387657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab41a-6025-4f25-b53b-b2e7717c05c9 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:39.418681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:39.427633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:39.428275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:39.428682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:39.429075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:39.437399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:39.439000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:39.451848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:39.453021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:39.454300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:39.458190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 621/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:39.459290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:39.524650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:39.575197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f7bb-518e-43cc-a456-ce3d42540974 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:39.612281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:39.612979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:39.613290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:39.613574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:39.614381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:39.614704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:39.616128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:39.635238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 633/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:39.641131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:39.756423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ab5-98e4-44ee-acae-1653c1400f40 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:39.796482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:39.797081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:39.797364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:39.797683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:39.865895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:39.882671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:39.884379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:39.995689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 622/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:41:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:41:40.001749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:40.111478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4269d1-1b2e-4a7f-9566-f1bf49acaf42 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:40.127362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:40.150323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:40.150986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:40.151276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:40.151556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:40.163027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:40.164508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:40.180874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:40.182057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:40.182994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:40.182994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:40.182994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:40.182994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:40.182994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 634/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:40.187999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:40.280245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:40.293764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d335-1bd6-4481-996b-01d8b73cb206 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:40.331123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:40.331885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:40.332200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:40.332481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:40.333194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:40.333502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:40.334920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:40.352458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 623/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:40.353840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:40.458372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce9f6-45bc-4356-82a3-ef9bc0bb6a59 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:40.492477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:40.493117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:40.493643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:40.493962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:40.500631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:40.502100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:40.513394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:40.514452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:40.515386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 635/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:40.520659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:40.624820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6badeb2-17b7-48bd-ad30-124d0cb59a0b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:40.659115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:40.660480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:40.660766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:40.661044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:40.661796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:40.662175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:40.663598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3eae-6b7a-49a5-9d39-7806f12ed59c None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:40.675383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 624/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:40.681460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:40.707675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:40.781074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c906-01fb-462f-9bc9-e6fed52c9cce None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:40.814881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:40.815522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:40.815927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:40.816311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:40.817003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=3fbdfe23df8c4200ac0d437c075942d8) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:40.817317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:40.818796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15549db9-11a8-4a26-8f70-e5b683fb3c36 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:40.824752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 636/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:41:40 2022] GET /identity/v3/role_assignments?user.id=3fbdfe23df8c4200ac0d437c075942d8&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:42.759669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6f69-810a-4de2-8f90-d8534702f30c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:42.760226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6f69-810a-4de2-8f90-d8534702f30c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:42.760226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6f69-810a-4de2-8f90-d8534702f30c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:42.761563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 625/1261] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:42.766718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:42.767137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:42.767277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:42.785707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:42.786906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:42.858740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 637/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:42.880606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6f69-810a-4de2-8f90-d8534702f30c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:42.891294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:42.981089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6f69-810a-4de2-8f90-d8534702f30c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.013771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.014362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.014639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.014909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.025630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:43.030550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:43.031662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:43.032587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 626/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:43.038346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.056659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:43.135989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76bcef-ce24-4932-97f3-e5473a77a168 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.169487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.170127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.170415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.170696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.171412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:43.171721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.173082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.180972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 638/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:43.186786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.254099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:43.287265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656723-dec3-462c-85ac-b859fcd9a717 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.319580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.320208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.320487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.320762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.330991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.333010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:43.347043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:43.348293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:43.349432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:43.349432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:43.349432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:43.349432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:43.349432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 627/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:43.355809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.433637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:43.452602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8003a-e2e0-4d37-ab32-0a5b4085c80e None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.484811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.485406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.485684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.485985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.486671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:43.486974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.488492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.499944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 639/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:43.506006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.602394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e88e-0ac0-4f36-805d-9081f2a97d88 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.621848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:43.635830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.636446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.636722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.636990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.644657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.646091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:43.656955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:43.658131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:43.659958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 628/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:43.664430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.761785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590045-d403-4d47-8ff2-97a889826b52 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.794365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.794970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.795254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.795530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.796317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:43.796627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.798068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.807477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:43.817033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 640/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:43.823256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:43.926603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658b51f-7583-44a1-8734-12b355722e3b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:43.958874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:43.959491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:43.959773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:43.960048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:43.970213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:43.971647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:43.985917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:43.986973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:43.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:43.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:43.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:43.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:43.992716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 629/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:43.993273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:44.090952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdc141-4254-4103-9d8a-473b9dbd20c8 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:44.124646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:44.125254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:44.125537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:44.125835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:44.126531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:44.126837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:44.128224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:44.139145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 641/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:44.145019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:44.176738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:44.243267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc685fb2-198d-4bc4-a0ac-a5c0566b2288 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:44.275025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:44.275636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:44.275913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:44.276183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:44.282668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:44.284068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:44.295672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:44.296751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:44.298121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 630/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:44.303034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:44.359954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:44.400896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb0c5-6dbb-4629-a5a6-832411eab5d3 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:44.433412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:44.433986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:44.434270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:44.434549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:44.435293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:44.435603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:44.437022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958114a-b9ac-4971-b554-25b877cff757 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:44.448575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 642/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:44.454463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:44.545227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:44.554456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b2ea-0776-4ad8-a4fd-3b6c2bab6099 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:44.587384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:44.588037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:44.588316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:44.588589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] PATH_INFO: `/v3/projects/046389bcbc1749f68c60601c6f651601/users/3fbdfe23df8c4200ac0d437c075942d8/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:44.590480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] RBAC: Authorizing `identity:create_grant(project_id=046389bcbc1749f68c60601c6f651601, user_id=3fbdfe23df8c4200ac0d437c075942d8, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:44.591892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56072-c22d-46f4-bbbe-11efa44fde60 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:44.605141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 631/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Jul 26 12:41:44 2022] PUT /identity/v3/projects/046389bcbc1749f68c60601c6f651601/users/3fbdfe23df8c4200ac0d437c075942d8/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:41:46.555128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b02d7-f9a4-4022-83c1-5902359c69a1 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:46.555662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b02d7-f9a4-4022-83c1-5902359c69a1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:46.555662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b02d7-f9a4-4022-83c1-5902359c69a1 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:46.557050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 643/1274] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:46.562154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:46.562578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:46.562698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:46.583024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:46.584183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:46.649140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 632/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:41:46.672332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b02d7-f9a4-4022-83c1-5902359c69a1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:46.770561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b02d7-f9a4-4022-83c1-5902359c69a1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:46.788160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:46.805446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:46.806179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:46.806659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:46.807010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:46.821066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 12:41:46.828274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:46.829338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:46.830256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 644/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Jul 26 12:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:46.836500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:46.915081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:46.934125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadc512-9032-430d-90f7-f5e161034c66 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:46.966878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:46.967481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:46.967761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:46.968034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:46.968737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:46.969039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:46.970413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:46.978746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 633/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Jul 26 12:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:46.984360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.082165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cdebf-02fd-4275-a992-f7988742cbfc None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:47.115772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:47.116404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:47.116689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:47.116965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:47.127394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:47.129126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:47.142775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:47.143742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:47.145174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:47.145174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:47.145174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:47.145174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:47.145174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 645/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:47.149718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.248090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940582d-7546-491f-a817-2b715736b5b1 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:47.280228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:47.280830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:47.281116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:47.281394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:47.282111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:47.282419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:47.283775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:47.295776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 634/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:47.301455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.332322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:47.399845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563510-2d22-48d8-8853-97d02eebbf7a None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:47.432143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:47.432760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:47.433042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:47.433316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:47.440421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:47.442495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 12:41:47.453364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:47.454506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:47.455816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 646/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 12:41:47.461380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.465132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:47.558944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa99ab-6bdd-4f23-aed4-22a2de12721b None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:47.591678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:47.592259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:47.592481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:47.592753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:47.593532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:47.593856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:47.595260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:47.612300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 635/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Jul 26 12:41:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:47.617957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.707132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:47.716983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3321-77c8-4ba9-a704-91d81880d422 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:47.749337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:47.749967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:47.750249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:47.750523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:47.817874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:47.819616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:47.908266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:47.918558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 647/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Jul 26 12:41:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 12:41:47.924348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:47.985209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:48.023772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd32b0-1c93-4dbb-b0d6-bab267581d10 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:48.057132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:48.057765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:48.058076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:48.058375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:48.068861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:48.070335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 12:41:48.085399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:48.086525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:48.087809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 12:41:48.087809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 12:41:48.087809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 12:41:48.087809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:48.087809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 636/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:48.092216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:48.189374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bae3-1d7f-4ca4-8490-346d427a39c1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:48.223089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:48.223704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:48.223987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:48.224262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:48.224951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:48.225256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:48.226644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:48.237612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 648/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Jul 26 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:48.243134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:48.341027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96c42f-53a6-4ae0-a9d1-ac6a8e8dbbfa None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:48.354650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:48.374515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:48.375134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:48.375414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:48.375686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:48.382209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:48.383637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 12:41:48.395306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:48.396373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: ERROR keystone.server.flask.application Jul 26 12:41:48.397386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 637/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Jul 26 12:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:48.402314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:48.451704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:48.501597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e986628-9232-4085-9df5-5557ced8a6c1 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:48.534414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:48.535018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:48.535302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:48.535580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:48.536322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:48.536627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:48.538069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134799-77c7-402a-be7d-5cdf5e10b4ae None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:48.549617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 649/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Jul 26 12:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:48.555721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:48.655200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693c4c0-078b-4a28-acca-05d21b5520a7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:48.687365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:48.687960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:48.688241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:48.688514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:48.689285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] RBAC: Adding query filter params (role.id=a56cff897dbf420ba7ea1c0895e3c4f0, scope.project.id=046389bcbc1749f68c60601c6f651601, user.id=3fbdfe23df8c4200ac0d437c075942d8) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:48.689591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:48.691566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71702-ec78-4dbf-9808-4c0ab102bb86 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:48.697162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 638/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Jul 26 12:41:48 2022] GET /identity/v3/role_assignments?user.id=3fbdfe23df8c4200ac0d437c075942d8&scope.project.id=046389bcbc1749f68c60601c6f651601&role.id=a56cff897dbf420ba7ea1c0895e3c4f0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:50.698657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d453-36b2-450c-91ae-8ee66dc2e706 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:50.699296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d453-36b2-450c-91ae-8ee66dc2e706 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:50.699296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d453-36b2-450c-91ae-8ee66dc2e706 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:50.700574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 650/1288] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:50.705674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:50.706208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:50.706349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:50.724406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:50.725583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:50.755136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:50.791802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 639/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:50.816731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d453-36b2-450c-91ae-8ee66dc2e706 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:50.926753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d453-36b2-450c-91ae-8ee66dc2e706 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:50.937074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:50.960062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:50.960636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:50.960919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:50.961195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:50.961836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:50.963208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:50.972326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:50.973676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:50.974896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 651/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:41:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:50.979740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:51.077164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10fd68-24e0-4f9d-a49d-a21e83ac9c46 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:51.110925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:51.111534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:51.111817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:51.112094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:51.112806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:51.113148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:51.114543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65901-b845-4e8d-ba27-6a886c2a8933 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:51.119849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 640/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Jul 26 12:41:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:51.125572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:51.223236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3066b8-9449-4cdf-9b9e-dc7409408d6c None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:51.255076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:51.255680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:51.255963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:51.256243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] PATH_INFO: `/v3/services` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:51.256913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:51.257219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:51.258606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c31e6-acd7-4d05-9750-e09af6504c89 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:51.262884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 652/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Jul 26 12:41:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:53.214680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453710a-a3a7-4d06-a3af-71be4ce554b1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:53.215236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453710a-a3a7-4d06-a3af-71be4ce554b1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:53.215236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453710a-a3a7-4d06-a3af-71be4ce554b1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:53.216580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 641/1293] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:53.222266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75ee6-7f14-4298-aaec-d9e4081e7695 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:53.222705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75ee6-7f14-4298-aaec-d9e4081e7695 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:53.222942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75ee6-7f14-4298-aaec-d9e4081e7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:53.241194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-83c75ee6-7f14-4298-aaec-d9e4081e7695 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:53.242402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-83c75ee6-7f14-4298-aaec-d9e4081e7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:53.270742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:53.307377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 653/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:53.329799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453710a-a3a7-4d06-a3af-71be4ce554b1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:53.361144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:53.432052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453710a-a3a7-4d06-a3af-71be4ce554b1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:53.464614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:53.465212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:53.465490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:53.465763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:53.466487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:53.467849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61679ad4-2c48-46a9-80f6-f0efc1626832 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:53.481678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 642/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Jul 26 12:41:53 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:41:55.449339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef58a0-ba73-4b53-80ce-7e9ab940c235 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:55.449949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef58a0-ba73-4b53-80ce-7e9ab940c235 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:55.449949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef58a0-ba73-4b53-80ce-7e9ab940c235 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:55.451306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 654/1296] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:55.457014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:55.457433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:55.457603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:55.475517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:55.476693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:55.547759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 643/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 12:41:55.570870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef58a0-ba73-4b53-80ce-7e9ab940c235 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:55.673081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef58a0-ba73-4b53-80ce-7e9ab940c235 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:55.707968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:55.708531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:55.708811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:55.709083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:55.709702 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:55.711088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:55.719543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:55.720738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:55.721639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 655/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:41:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:55.727007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:55.745689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:55.828409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5a08-48ae-4e77-8205-01f051a3fce2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:55.870057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:55.870711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:55.870966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:55.871243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:55.871928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:55.872237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:55.873624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:55.879444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 644/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Jul 26 12:41:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:55.885614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:55.916370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:55.983595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7948c-cb8e-4fed-bb79-997f4a6576d4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:56.016559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:56.017165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:56.017451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:56.017730 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:56.018534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] RBAC: Adding query filter params (interface=public, service_id=de68b249bb984d11b7fb803b7a3023f6, region_id=RegionOne) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:56.018851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:56.020209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40b495-f48c-4af3-af62-76b96885d38f None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:56.025376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 656/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Jul 26 12:41:55 2022] GET /identity/v3/endpoints?service_id=de68b249bb984d11b7fb803b7a3023f6&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:41:56.030832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:56.111169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:56.130286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23305-62f3-4488-a923-38afce636ad7 None admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:56.163407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:56.164011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:56.164295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:56.164571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:56.165213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:56.166591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d694ef-bb78-4e46-a919-dada2114eb8b None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:56.173220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 645/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Jul 26 12:41:56 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:41:58.132214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0075b1-3587-42c9-a569-245606fbb0c6 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:58.132757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0075b1-3587-42c9-a569-245606fbb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:58.132757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0075b1-3587-42c9-a569-245606fbb0c6 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:58.134145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 657/1302] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:41:58.139223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:58.139606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:58.139778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:58.157892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:41:58.160116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:41:58.225033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 646/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:41:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 12:41:58.247665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0075b1-3587-42c9-a569-245606fbb0c6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:58.338684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:58.345852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0075b1-3587-42c9-a569-245606fbb0c6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:58.378557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:58.379172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:58.379451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:58.379725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:58.380341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:58.381684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 12:41:58.390216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 12:41:58.391391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application with Lock( Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self._enter() Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application return self.creator() Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application created_value = creator( Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: ERROR keystone.server.flask.application Jul 26 12:41:58.392437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 658/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Jul 26 12:41:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 12:41:58.397412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:58.470963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:41:58.495293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88a41-9dcb-443a-a3db-8e18974c73dd None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:58.527871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:58.528472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:58.528751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:58.529022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] PATH_INFO: `/v3/services` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:58.529697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:41:58.530031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:58.531369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f537c57-275c-4049-add8-c7b827a75d53 None admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:58.536962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 647/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Jul 26 12:41:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:41:58.542628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:41:58.639470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bb1f-9802-4aeb-b512-754846a35af4 None admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:41:58.672266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:41:58.672863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:41:58.673142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:41:58.673414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:41:58.674143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:41:58.675522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657065-ae74-4f13-8901-9bd6028ae6b7 None admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:41:58.695720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 659/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:41:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:42:08.533430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=30 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:42:08.690850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:00.996382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51b7aa-44a5-49f8-92f6-1767b98637c7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:00.996972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51b7aa-44a5-49f8-92f6-1767b98637c7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:00.996972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51b7aa-44a5-49f8-92f6-1767b98637c7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:01.002729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 648/1307] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:01.004136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b071e8-2f34-4883-9ab1-dfaac215d9e2 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:01.004582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b071e8-2f34-4883-9ab1-dfaac215d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:01.004689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b071e8-2f34-4883-9ab1-dfaac215d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:01.095523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a3b071e8-2f34-4883-9ab1-dfaac215d9e2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:01.097074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a3b071e8-2f34-4883-9ab1-dfaac215d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:01.250531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 660/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:43:01.285234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:01.285758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:01.285899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:01.288568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 649/1309] 10.222.0.47 () {54 vars in 965 bytes} [Tue Jul 26 12:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:01.295527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c5f7-403b-47cc-9cb8-b945dd34e1c7 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:01.295888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c5f7-403b-47cc-9cb8-b945dd34e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:01.296298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c5f7-403b-47cc-9cb8-b945dd34e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:01.398603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-cff1c5f7-403b-47cc-9cb8-b945dd34e1c7 None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:01.400014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cff1c5f7-403b-47cc-9cb8-b945dd34e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:01.425778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:01.494027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 661/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Jul 26 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:43:01.496722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:01.499332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:01.623343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d636be-7aaa-43b7-a1b3-b842afe8b313 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:01.702415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:01.703040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:01.703331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:01.703605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:01.705936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:01.764732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:01.825824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:01.827290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9de69-d4b1-4ba7-b408-8b204ef3847c service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:01.849280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 650/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:04.146496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:04.147025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:04.147118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:04.148434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 662/1312] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:04.153621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb8bf-ed8e-4d1d-804f-7c6084bb8534 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:04.154073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb8bf-ed8e-4d1d-804f-7c6084bb8534 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:04.154206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fb8bf-ed8e-4d1d-804f-7c6084bb8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:04.235373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2c8fb8bf-ed8e-4d1d-804f-7c6084bb8534 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:04.236642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2c8fb8bf-ed8e-4d1d-804f-7c6084bb8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:04.340336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 651/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:04.380638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:04.382407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:04.490755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b02e77-c034-4257-b6af-6b58d3a997ce None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:04.562003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:04.565646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:04.566297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:04.566888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:04.567340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:04.569268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:04.681715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:04.683197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bd627-20f6-42cb-85c4-3b373d9869cc service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:04.703145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 663/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:07.007082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bce0-0b24-4cf8-9e6c-904ea5db99b1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:07.007643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bce0-0b24-4cf8-9e6c-904ea5db99b1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:07.007643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bce0-0b24-4cf8-9e6c-904ea5db99b1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:07.009005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 652/1315] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:07.014355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdd5e0-afbf-43da-af2c-857e26241492 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:07.014756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdd5e0-afbf-43da-af2c-857e26241492 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:07.014970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdd5e0-afbf-43da-af2c-857e26241492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:07.084248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-98cdd5e0-afbf-43da-af2c-857e26241492 None None] MFA Rules not processed for user `3b526510f605469fa3a323c8954b9ded`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:07.085525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-98cdd5e0-afbf-43da-af2c-857e26241492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:07.139872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:07.185201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 664/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:07.242416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:07.242785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:07.243065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:07.244445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 653/1317] 10.222.0.47 () {54 vars in 965 bytes} [Tue Jul 26 12:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:07.250686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa5708-c647-4011-ba65-e803d5d246ad None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:07.251031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa5708-c647-4011-ba65-e803d5d246ad None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:07.251838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa5708-c647-4011-ba65-e803d5d246ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:07.328977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e1aa5708-c647-4011-ba65-e803d5d246ad None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:07.331078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e1aa5708-c647-4011-ba65-e803d5d246ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:07.406404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 665/1318] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Jul 26 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:07.415394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:07.417078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:07.427087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:07.523655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577d63-6a3a-4de4-a792-21dfa3c0bebf None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:07.596095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:07.596696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:07.596972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:07.597240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:07.598868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:07.660126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:07.708171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:07.709636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f940b-8dd1-4a75-98b5-4f664326e8e4 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:07.727333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 654/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:10.647914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:10.648456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:10.648456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:10.649886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 666/1320] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:10.654867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e52b6-6319-4dc3-99a1-29aa13a92d99 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:10.655279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e52b6-6319-4dc3-99a1-29aa13a92d99 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:10.655430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e52b6-6319-4dc3-99a1-29aa13a92d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:10.721860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5f5e52b6-6319-4dc3-99a1-29aa13a92d99 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:10.723061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5f5e52b6-6319-4dc3-99a1-29aa13a92d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:10.818281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 655/1321] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:10.858063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:10.859609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:10.910163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:10.964055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538ef49-c41b-4610-8a33-0073bd2a7cd8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:11.037096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:11.037719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:11.038033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:11.038313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:11.039954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:11.135814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:11.149431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:11.150900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c0c26-878d-4968-9942-9eb0270e34ed service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:11.169240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 667/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:13.871613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:13.872173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:13.872173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:13.873530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 656/1323] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:13.878934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ee52-184f-4011-bc37-4f37ca321f4a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:13.879364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ee52-184f-4011-bc37-4f37ca321f4a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:13.879504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ee52-184f-4011-bc37-4f37ca321f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:13.946311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1fe9ee52-184f-4011-bc37-4f37ca321f4a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:13.952083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1fe9ee52-184f-4011-bc37-4f37ca321f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:14.054642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 668/1324] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:14.090964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:14.092531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:14.114566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:14.207375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6c88e-d2d5-431c-a4c2-984fc51247eb None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:14.280229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:14.280845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:14.281124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:14.281394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:14.283650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:14.355718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:14.394456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:14.395895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bb6e4-5049-4df6-96f7-7f8642ade715 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:14.414333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 657/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:16.468810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:16.469350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:16.469350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:16.471414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 669/1326] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:16.476708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f14-32b4-4c50-9f2f-3bcf01a9a358 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:16.477140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f14-32b4-4c50-9f2f-3bcf01a9a358 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:16.477266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f14-32b4-4c50-9f2f-3bcf01a9a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:16.542739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-58d31f14-32b4-4c50-9f2f-3bcf01a9a358 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:16.543883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-58d31f14-32b4-4c50-9f2f-3bcf01a9a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:16.644432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 658/1327] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:16.681012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:16.682686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:16.744604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:16.788306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a464d-c9d9-4a6a-9de5-f634785ceb2c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:16.864261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:16.864883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:16.865164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:16.865438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:16.867084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:16.981940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:16.984424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:16.986540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84704f16-2a79-4e01-9980-28837f275682 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:17.005905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 670/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:19.061939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:19.062491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:19.062491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:19.063921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 659/1329] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:19.069748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627dab-437b-4868-8bd8-73f666e816eb None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:19.070319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627dab-437b-4868-8bd8-73f666e816eb None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:19.070319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627dab-437b-4868-8bd8-73f666e816eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:19.138547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d4627dab-437b-4868-8bd8-73f666e816eb None None] MFA Rules not processed for user `3b526510f605469fa3a323c8954b9ded`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:19.139786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d4627dab-437b-4868-8bd8-73f666e816eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:19.238619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 671/1330] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:19.276624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:19.278228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:19.309670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:19.389584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4c16-c37d-41ef-ad0e-4f8d033adbf8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:19.462471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:19.463084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:19.463366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:19.463643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:19.465262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:19.543485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:19.578062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:19.580340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb5f0-84de-4b5b-998a-6d3b9c1e573d service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:19.600002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 660/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:21.873321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:21.873952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:21.873952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:21.875278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 672/1332] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:21.880831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575840-d99c-483c-a1d3-daa2804f3f19 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:21.881249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575840-d99c-483c-a1d3-daa2804f3f19 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:21.881400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575840-d99c-483c-a1d3-daa2804f3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:21.946595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ef575840-d99c-483c-a1d3-daa2804f3f19 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:21.947796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ef575840-d99c-483c-a1d3-daa2804f3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:22.044854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 661/1333] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:22.081416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:22.083025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:22.151496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:22.185653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af65a7-a6e7-4b64-b8cf-a56afd45c4fc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:22.265713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:22.266369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:22.266655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:22.266934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:22.268568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:22.376426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:22.377878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879bc5b-14b1-4ee9-8808-72d1e2bf27e5 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:22.387611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:22.396031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 673/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:24.434411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:24.434975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:24.434975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:24.436311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 662/1335] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:24.442120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892cff5-07ee-4b39-9a96-418601b1fcec None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:24.442539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892cff5-07ee-4b39-9a96-418601b1fcec None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:24.442691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892cff5-07ee-4b39-9a96-418601b1fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:24.508625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d892cff5-07ee-4b39-9a96-418601b1fcec None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:24.509845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d892cff5-07ee-4b39-9a96-418601b1fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:24.604999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 674/1336] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:24.646334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:24.647934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:24.687692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:24.754938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69852-0c14-441a-b836-3a49d582558f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:24.826779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:24.827386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:24.827662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:24.827932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:24.830143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:24.912174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:24.938004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:24.940058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51311f-d9e2-4147-a967-b770711b7adc service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:24.957524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 663/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:27.274220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:27.274779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:27.274779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:27.276142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 675/1338] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:27.281670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6ea9-f36b-4edd-abd2-81a895443346 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:27.282216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6ea9-f36b-4edd-abd2-81a895443346 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:27.282542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f6ea9-f36b-4edd-abd2-81a895443346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:27.349461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0f8f6ea9-f36b-4edd-abd2-81a895443346 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:27.350778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0f8f6ea9-f36b-4edd-abd2-81a895443346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:27.447377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 664/1339] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:27.483419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:27.484949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:27.559767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:27.588773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f16e6-6ce2-4efa-af13-c59228418409 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:27.662994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:27.663539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:27.663822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:27.664098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:27.665709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:27.775100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:27.776548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63c4e-23dd-49e2-9b24-0c352e35bd41 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:27.794941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 676/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:31.757700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:31.758359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:31.758359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:31.759647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 665/1341] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:31.764703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b29b-2291-4dac-822b-b14eac704203 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:31.765146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b29b-2291-4dac-822b-b14eac704203 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:31.765271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b29b-2291-4dac-822b-b14eac704203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:31.770904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:31.834517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ff33b29b-2291-4dac-822b-b14eac704203 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:31.835772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ff33b29b-2291-4dac-822b-b14eac704203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:31.933673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 677/1342] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:31.972391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:31.973950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:32.022636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:32.080181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be3773-9481-4c33-b304-f6d62e30fe1a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:32.161962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:32.162502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:32.162787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:32.163066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:32.164684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:32.262722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:32.279851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:32.281287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb5723-18e8-4b17-8f8a-9c8b30d12b20 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:32.299778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 666/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:35.127800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:35.128330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:35.128451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:35.129765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 678/1344] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:43:35.135046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9979-721f-44b6-8c6b-84bf7c0668e0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:35.135482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9979-721f-44b6-8c6b-84bf7c0668e0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:35.135722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9979-721f-44b6-8c6b-84bf7c0668e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:35.202937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-57eb9979-721f-44b6-8c6b-84bf7c0668e0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:35.204717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-57eb9979-721f-44b6-8c6b-84bf7c0668e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:35.302766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 667/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:43:35.340367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:35.341954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:35.433561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:35.452285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cd6e-e945-4dfc-8bd7-aca1faf1e60c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:35.529954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:35.530576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:35.530859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:35.531136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:35.532913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:35.653377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:35.654896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e3d0-a005-4205-bb06-267252d17697 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:35.675677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 679/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:39.724016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:39.724507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:39.724601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:39.726118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 668/1347] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:39.731415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcad86-1d58-4ff1-9f01-f0242e0dcab5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:39.731924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcad86-1d58-4ff1-9f01-f0242e0dcab5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:39.732020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcad86-1d58-4ff1-9f01-f0242e0dcab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:39.748781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:39.803889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-35bcad86-1d58-4ff1-9f01-f0242e0dcab5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:39.805109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-35bcad86-1d58-4ff1-9f01-f0242e0dcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:39.909116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 680/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:39.947456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:39.948976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:40.009488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:40.059210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51bee-516f-4deb-b636-58cf66cf911d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:40.134559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:40.135174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:40.135451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:40.135718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:40.137327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:40.248464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:40.252882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:40.254418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e56b6-dfe2-4416-93c3-1c30010b9e87 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:40.272084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 669/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:45.105015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f68a-b971-4ad4-8133-b0c8fe356c99 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:45.105491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f68a-b971-4ad4-8133-b0c8fe356c99 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:45.105491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f68a-b971-4ad4-8133-b0c8fe356c99 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:45.106924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 681/1350] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:45.112827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fa97-4e55-4f47-8601-c1a9b76bf430 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:45.113226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fa97-4e55-4f47-8601-c1a9b76bf430 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:45.113424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fa97-4e55-4f47-8601-c1a9b76bf430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:45.246993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-bb42fa97-4e55-4f47-8601-c1a9b76bf430 None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:45.248115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bb42fa97-4e55-4f47-8601-c1a9b76bf430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:45.383296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 670/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:43:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:49.449652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0838e-6585-4955-ad91-a8745799fd11 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:49.450213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0838e-6585-4955-ad91-a8745799fd11 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:49.450343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0838e-6585-4955-ad91-a8745799fd11 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:49.451944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 682/1352] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:49.457610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2443e-691f-41fa-a7e7-d055cf489d56 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:49.458096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2443e-691f-41fa-a7e7-d055cf489d56 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:49.458463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2443e-691f-41fa-a7e7-d055cf489d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:49.515558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:49.539514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0de2443e-691f-41fa-a7e7-d055cf489d56 None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:49.540727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0de2443e-691f-41fa-a7e7-d055cf489d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:49.657228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 671/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:43:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:49.907077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=59 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:51.076202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae6c1-b9aa-4a25-8581-e790a561b73d None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:51.076841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae6c1-b9aa-4a25-8581-e790a561b73d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:51.076841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae6c1-b9aa-4a25-8581-e790a561b73d None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:51.078147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 683/1354] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:51.083822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea15e0-d0da-451f-8bb8-9f0114d533d9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:51.084255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea15e0-d0da-451f-8bb8-9f0114d533d9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:51.084372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea15e0-d0da-451f-8bb8-9f0114d533d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:51.160955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2bea15e0-d0da-451f-8bb8-9f0114d533d9 None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:51.162184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2bea15e0-d0da-451f-8bb8-9f0114d533d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:51.204314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:51.270369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 672/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:54.569925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc86f-6f16-46e2-b8d9-4e6c9f60fcde None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:54.570834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc86f-6f16-46e2-b8d9-4e6c9f60fcde None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:54.571278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc86f-6f16-46e2-b8d9-4e6c9f60fcde None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:54.576421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 684/1356] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:54.578225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22eb3d-c95f-4304-8c95-d26c172ffec3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:54.579830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22eb3d-c95f-4304-8c95-d26c172ffec3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:54.580292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22eb3d-c95f-4304-8c95-d26c172ffec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:54.665443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ea22eb3d-c95f-4304-8c95-d26c172ffec3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:54.666776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ea22eb3d-c95f-4304-8c95-d26c172ffec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:54.777950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 673/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:54.831762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:54.832755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:54.833245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:54.834952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 685/1358] 10.222.0.47 () {54 vars in 962 bytes} [Tue Jul 26 12:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:54.843499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d1835-1ade-45d4-ba4b-a47a00242214 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:54.844701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d1835-1ade-45d4-ba4b-a47a00242214 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:54.845198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d1835-1ade-45d4-ba4b-a47a00242214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:54.865708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:54.935490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-866d1835-1ade-45d4-ba4b-a47a00242214 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:54.936845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-866d1835-1ade-45d4-ba4b-a47a00242214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:55.063837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 674/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Jul 26 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:55.071895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:55.073488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:55.227427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5796c9-7b62-43ed-af1d-e3e6f23f2a7e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:55.304341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:55.347240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:55.347874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:55.348164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:55.348707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:55.350456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:55.455876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:55.457554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390203ff-cfbb-49de-98b0-d9fa54648967 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:55.477036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 686/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:43:57.704602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:57.704602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:57.705399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:57.711628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1702-1c3e-4974-a951-b5ad924e4874 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:57.712191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1702-1c3e-4974-a951-b5ad924e4874 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:57.712191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1702-1c3e-4974-a951-b5ad924e4874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:57.713890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 675/1361] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:43:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:43:57.784039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-848f1702-1c3e-4974-a951-b5ad924e4874 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:43:57.785645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-848f1702-1c3e-4974-a951-b5ad924e4874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:57.826323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:57.888917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 687/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:43:57.933165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:43:57.934681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:58.017060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:58.118049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37692cd-f73f-4ed5-a208-46a1fbcd2386 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:43:58.259495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:43:58.260150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:43:58.260150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:43:58.260739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:43:58.262320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:43:58.287425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:58.363383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:43:58.365106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e52ac7-ff76-4eee-afd0-c6f5b3919976 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:43:58.384711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 676/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:00.747258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154905f-30d6-4501-9add-49df013bfff3 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:00.747775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154905f-30d6-4501-9add-49df013bfff3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:00.747892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154905f-30d6-4501-9add-49df013bfff3 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:00.749178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 688/1364] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:00.754983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc8af-9878-47ee-ac00-02941c01e8c0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:00.755782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc8af-9878-47ee-ac00-02941c01e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:00.756100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc8af-9878-47ee-ac00-02941c01e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:00.836843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ad4bc8af-9878-47ee-ac00-02941c01e8c0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:00.838328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ad4bc8af-9878-47ee-ac00-02941c01e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:00.957293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:00.961256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 677/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:01.009160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:01.009517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:01.009931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:01.012361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 689/1366] 10.222.0.47 () {54 vars in 962 bytes} [Tue Jul 26 12:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:01.022080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067526-e686-400b-9605-68c74bcb0f2e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:01.026124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067526-e686-400b-9605-68c74bcb0f2e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:01.026696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067526-e686-400b-9605-68c74bcb0f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:01.122642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ed067526-e686-400b-9605-68c74bcb0f2e None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:01.123850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ed067526-e686-400b-9605-68c74bcb0f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:01.262668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 678/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Jul 26 12:44:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:01.271540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:01.273045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:01.453234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fb681-d60d-471a-afcd-9324c0c361ac None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:01.483168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:01.597766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:01.599121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:01.599569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:01.599851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:01.601667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:01.707151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:01.708759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4ee6f-cab4-40c2-89a0-6e7a80e7e7e8 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:01.731847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 690/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:02.687234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eff025-b229-45df-90cc-608d1949c218 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:02.687918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eff025-b229-45df-90cc-608d1949c218 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:02.687918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eff025-b229-45df-90cc-608d1949c218 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:02.692921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 679/1369] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:02.694761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21566-b173-4125-b836-d232fd28f65d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:02.695213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21566-b173-4125-b836-d232fd28f65d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:02.695297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21566-b173-4125-b836-d232fd28f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:02.728448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:02.766195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c3a21566-b173-4125-b836-d232fd28f65d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:02.767437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c3a21566-b173-4125-b836-d232fd28f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:02.882039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 691/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:03.223800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:03.225929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:03.225929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:03.225929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 680/1371] 10.222.0.47 () {54 vars in 964 bytes} [Tue Jul 26 12:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:03.231182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110d9d-4463-42a2-ae21-8ccd9516aa90 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:03.231569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110d9d-4463-42a2-ae21-8ccd9516aa90 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:03.231950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110d9d-4463-42a2-ae21-8ccd9516aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:03.312645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ff110d9d-4463-42a2-ae21-8ccd9516aa90 None None] MFA Rules not processed for user `2135e982052e41cc834c5c0a6608decc`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:03.313936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ff110d9d-4463-42a2-ae21-8ccd9516aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:03.364158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:03.400210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 692/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Jul 26 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:03.408401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:03.409976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:03.469902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:03.530317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63d9d-defb-4b25-b5de-336e6e03b2df None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:03.610972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:03.611586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:03.611863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:03.612132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:03.613859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:03.721289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:03.735227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:03.736726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521571-8b23-4e60-b822-660678440eed service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:03.756080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 681/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:03.854311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:03.854886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:03.854886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:03.860682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 693/1374] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:03.862154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e769d-b58e-458c-a49a-96f16286c007 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:03.862390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e769d-b58e-458c-a49a-96f16286c007 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:03.862671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e769d-b58e-458c-a49a-96f16286c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:03.934790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e64e769d-b58e-458c-a49a-96f16286c007 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:03.936006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e64e769d-b58e-458c-a49a-96f16286c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:04.065970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 682/1375] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:04.112508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:04.114864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:04.284071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525415-4eba-4e49-ac3e-9fd290a4df50 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:04.350652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:04.413957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:04.414619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:04.414908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:04.415182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:04.416856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:04.510645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:04.512291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674e59d-fcaa-434b-b516-a4bb6db4f83d service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:04.531309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 694/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:06.587021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:06.587564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:06.587564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:06.588924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 683/1377] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:06.594519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bd0f-701e-4b17-a9f1-a8b07aae3c1a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:06.594947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bd0f-701e-4b17-a9f1-a8b07aae3c1a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:06.595099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bd0f-701e-4b17-a9f1-a8b07aae3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:06.676957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-72d6bd0f-701e-4b17-a9f1-a8b07aae3c1a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:06.678377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-72d6bd0f-701e-4b17-a9f1-a8b07aae3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:06.685450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:06.799847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 695/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:06.845159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:06.846651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:06.910977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:07.003013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab01412-91b3-4c9f-b303-0d0617fc922e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:07.141953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:07.142574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:07.142857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:07.143129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:07.144783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:07.179444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:07.296949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:07.299013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24ef47-a816-4c6f-b056-9e10b5d6dad8 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:07.322076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 684/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:09.399015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:09.399604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:09.399604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:09.401096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 696/1380] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:09.406310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a1046-6010-4aa2-967f-68957fba5cd1 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:09.406747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a1046-6010-4aa2-967f-68957fba5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:09.406876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a1046-6010-4aa2-967f-68957fba5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:09.477220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8c5a1046-6010-4aa2-967f-68957fba5cd1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:09.478473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8c5a1046-6010-4aa2-967f-68957fba5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:09.590822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:09.593991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 685/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:09.637027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:09.638841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:09.789934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:09.801829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ccea7-6cca-4aa4-8a82-c40adae13f09 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:09.928195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:09.928820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:09.929111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:09.929396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:09.931070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:10.043782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:10.045522 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f611047-1493-4478-9ff7-8f74e6b4fb2d service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:10.059612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:10.072029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 697/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:12.130232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:12.130846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:12.130846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:12.132156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 686/1383] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:12.142578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed6ca-5889-4442-9aec-13207a63919f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:12.143191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed6ca-5889-4442-9aec-13207a63919f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:12.143359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed6ca-5889-4442-9aec-13207a63919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:12.213377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2faed6ca-5889-4442-9aec-13207a63919f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:12.214781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2faed6ca-5889-4442-9aec-13207a63919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:12.338175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 698/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:44:12.377637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:12.379254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:12.535458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48052c3e-2f95-4e57-bfa8-5ee303b0bec2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:12.606866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:12.666837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:12.667580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:12.667937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:12.668281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:12.670396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:12.790003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:12.791763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85781b-72e2-420e-a435-a66235addf84 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:12.814890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 687/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:15.086683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:15.087248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:15.087349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:15.089047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 699/1386] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:15.095010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341a8f7-1683-41af-91ba-d9c966ce480e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:15.095455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341a8f7-1683-41af-91ba-d9c966ce480e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:15.095684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341a8f7-1683-41af-91ba-d9c966ce480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:15.177077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c341a8f7-1683-41af-91ba-d9c966ce480e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:15.178674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c341a8f7-1683-41af-91ba-d9c966ce480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:15.219478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:15.296800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 688/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:15.344728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:15.346766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:15.432198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:15.517110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686b8b6-5a99-467b-90fa-23cfc3ab2327 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:15.636980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:15.637607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:15.637922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:15.638201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:15.639958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:15.681511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:15.734923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:15.736555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e202582-5655-45f0-82ea-283ff42c916a service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:15.756805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 700/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:17.841048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:17.841626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:17.841626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:17.843829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 689/1389] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:17.848870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ed07-56e9-457d-814a-e9f532893abe None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:17.849320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ed07-56e9-457d-814a-e9f532893abe None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:17.849434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ed07-56e9-457d-814a-e9f532893abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:17.916568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ec19ed07-56e9-457d-814a-e9f532893abe None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:17.917765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ec19ed07-56e9-457d-814a-e9f532893abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:18.014435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 701/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:18.059732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:18.061284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:18.213381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd65e-f3d4-4f89-b5f1-c4900336dea6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:18.231160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:18.331907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:18.332550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:18.332840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:18.333112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:18.334757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:18.425252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:18.426885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41843cf-440f-4b68-9858-16cd16e2530c service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:18.445569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 690/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:19.543844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad7f4-ec98-4aff-bc11-1008f2be6f6a None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:19.544392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad7f4-ec98-4aff-bc11-1008f2be6f6a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:19.544485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad7f4-ec98-4aff-bc11-1008f2be6f6a None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:19.545911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 702/1392] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:19.551601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6d6b-c575-42ba-b650-bc0d73db7732 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:19.552058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6d6b-c575-42ba-b650-bc0d73db7732 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:19.552157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6d6b-c575-42ba-b650-bc0d73db7732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:19.579225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:19.624756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4f8d6d6b-c575-42ba-b650-bc0d73db7732 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:19.626017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4f8d6d6b-c575-42ba-b650-bc0d73db7732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:19.724263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 691/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:19.779876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:19.780281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:19.780574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:19.781952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 703/1394] 10.222.0.47 () {54 vars in 966 bytes} [Tue Jul 26 12:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:19.786991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71136-251b-434a-9b32-71ac9f37ac22 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:19.787278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71136-251b-434a-9b32-71ac9f37ac22 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:19.787560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71136-251b-434a-9b32-71ac9f37ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:19.863420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8df71136-251b-434a-9b32-71ac9f37ac22 None None] MFA Rules not processed for user `6c2579707a174cd3ba2d235e6ec548bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:19.864622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8df71136-251b-434a-9b32-71ac9f37ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:19.905692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:19.943075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 692/1395] 10.222.0.47 () {58 vars in 1063 bytes} [Tue Jul 26 12:44:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:19.950703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:19.952894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:19.966510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:20.063595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ce5ab-bd13-4f5f-b056-3a4d56186ac5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:20.138443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:20.138982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:20.139268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:20.140219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:20.142184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:20.210959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:20.254363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:20.255868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d916f5-f4aa-44ad-803c-cc69286887e3 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:20.273949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 704/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:20.502804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:20.503128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:20.503413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:20.505186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 693/1397] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:20.511179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e7c3-3c31-46f5-944a-1df53877724b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:20.511468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e7c3-3c31-46f5-944a-1df53877724b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:20.511743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e7c3-3c31-46f5-944a-1df53877724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:20.587096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0a77e7c3-3c31-46f5-944a-1df53877724b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:20.588336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0a77e7c3-3c31-46f5-944a-1df53877724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:20.708837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 705/1398] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:20.754617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:20.756138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:20.918824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7939f2-aad9-405f-a22d-b579d7041569 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:20.975693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:21.017120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347f85-e4a7-480f-bf97-b61a9bf0618d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:21.017488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347f85-e4a7-480f-bf97-b61a9bf0618d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:21.017890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347f85-e4a7-480f-bf97-b61a9bf0618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:21.046263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:21.050422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:21.051052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:21.051466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:21.051747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:21.053421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:21.087045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-21347f85-e4a7-480f-bf97-b61a9bf0618d None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:21.088333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-21347f85-e4a7-480f-bf97-b61a9bf0618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:21.147917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:21.149788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495c716-938d-4d53-bbb9-4622dbf61852 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:21.167989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 694/1399] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:21.176861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 706/1400] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:21.223761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:21.224083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:21.224364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:21.225851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 695/1401] 10.222.0.47 () {54 vars in 943 bytes} [Tue Jul 26 12:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:21.231982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056d82-7f1c-48c9-a056-b99a7033a974 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:21.233617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056d82-7f1c-48c9-a056-b99a7033a974 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:21.233995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056d82-7f1c-48c9-a056-b99a7033a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:21.322848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-02056d82-7f1c-48c9-a056-b99a7033a974 None None] MFA Rules not processed for user `182ee307b1394f72bc71477eb027da49`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:21.324102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-02056d82-7f1c-48c9-a056-b99a7033a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:21.384595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:21.441046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 707/1402] 10.222.0.47 () {58 vars in 1040 bytes} [Tue Jul 26 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:21.450330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:21.451924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:21.508953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:21.588206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06079-4ab4-4341-a803-fe58886deaf8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:21.693270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:21.693924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:21.694219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:21.694490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:21.696153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:21.735618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:21.783662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:21.785177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b98a-1f36-496a-8840-1a818f1e3725 service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:21.793418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 696/1403] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:44:23.207132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:23.208516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:23.208805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:23.210485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 708/1404] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:23.215362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195b58-ddb2-4286-bf9d-cef6f307a660 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:23.215808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195b58-ddb2-4286-bf9d-cef6f307a660 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:23.216099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195b58-ddb2-4286-bf9d-cef6f307a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:23.293637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5e195b58-ddb2-4286-bf9d-cef6f307a660 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:23.294814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5e195b58-ddb2-4286-bf9d-cef6f307a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:23.401475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 697/1405] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:44:23.446757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:23.448531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:23.614454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa303-e3a5-4191-8335-5368a01f4a2f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:23.654299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:23.768785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:23.769418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:23.769707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:23.770014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:23.771904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:23.876794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:23.878413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06da6f-6a84-4fd6-8211-c8b866313a83 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:23.902363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 709/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:25.962367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:25.962946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:25.962946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:25.964299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 698/1407] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:25.970207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84f47-cfb6-4594-bbaa-1f18234e733a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:25.971009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84f47-cfb6-4594-bbaa-1f18234e733a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:25.971372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84f47-cfb6-4594-bbaa-1f18234e733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:26.017636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:26.053755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-31f84f47-cfb6-4594-bbaa-1f18234e733a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:26.055021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-31f84f47-cfb6-4594-bbaa-1f18234e733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:26.164817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 710/1408] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:26.210478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:26.212098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:26.246202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:26.375742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35725e-ebed-48c0-affd-b169f3d64df7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:26.486056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:26.499399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:26.499953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:26.500235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:26.500512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:26.502183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:26.605619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:26.607360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467d1a-2fa0-4bc9-98de-8a9b45c80dfa service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:26.630282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 699/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:36.162280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=51 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:36.627265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=49 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:44.460395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916070-b064-4598-9842-625613a7e0ed None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:44.460970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916070-b064-4598-9842-625613a7e0ed None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:44.460970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916070-b064-4598-9842-625613a7e0ed None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:44.462447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 711/1410] 10.222.0.47 () {54 vars in 918 bytes} [Tue Jul 26 12:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:44.468286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387eccd-b48b-492f-8417-481e96ea2b4f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:44.468733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387eccd-b48b-492f-8417-481e96ea2b4f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:44.468837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387eccd-b48b-492f-8417-481e96ea2b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:44.543847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e387eccd-b48b-492f-8417-481e96ea2b4f None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:44.545079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e387eccd-b48b-492f-8417-481e96ea2b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:44.651380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 700/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jul 26 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:44.666077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1a5b-44ec-47d4-a5dc-5870fcb54aa0 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:44.666400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1a5b-44ec-47d4-a5dc-5870fcb54aa0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:44.666680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1a5b-44ec-47d4-a5dc-5870fcb54aa0 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:44.668126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 712/1412] 10.222.0.47 () {54 vars in 918 bytes} [Tue Jul 26 12:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:44.672966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832559-58dc-48c4-a2d6-9311598b49ab None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:44.673257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832559-58dc-48c4-a2d6-9311598b49ab None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:44.673537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832559-58dc-48c4-a2d6-9311598b49ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:44.747967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:44.751261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b3832559-58dc-48c4-a2d6-9311598b49ab None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:44.753017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b3832559-58dc-48c4-a2d6-9311598b49ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:44.869650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 701/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jul 26 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:47.345497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:47.346073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:47.346073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:47.347447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:47.352565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd228-0cca-4e1c-9922-68ac49377646 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:47.353013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd228-0cca-4e1c-9922-68ac49377646 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:47.353123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd228-0cca-4e1c-9922-68ac49377646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:47.419761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-489fd228-0cca-4e1c-9922-68ac49377646 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:47.420951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-489fd228-0cca-4e1c-9922-68ac49377646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:47.474573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:47.516610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:47.559888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:47.561503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:47.706405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebafb1-c19d-4d2c-a3af-836af207868a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:47.779632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:47.819440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:47.820058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:47.820338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:47.820611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:47.822266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:47.911060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:47.912655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97f39-1480-4312-b607-cf26d75b20e7 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:47.930275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 714/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:48.832970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:48.833488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:48.833612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:48.834925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:48.839666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa204-11aa-4f17-b5bd-d95ec9371282 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:48.840677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa204-11aa-4f17-b5bd-d95ec9371282 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:48.840789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa204-11aa-4f17-b5bd-d95ec9371282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:48.916020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e82fa204-11aa-4f17-b5bd-d95ec9371282 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:48.917210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e82fa204-11aa-4f17-b5bd-d95ec9371282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:48.950457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:49.019214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:49.170619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:49.172216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:49.317230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca24f5-f2ed-47c1-9471-3b41ccd37c10 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:49.356766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:49.428980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:49.429586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:49.429958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:49.430240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:49.431841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:49.522041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:49.523613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe9264-31cd-4c6b-ab46-93f74232ac37 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:49.541621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 704/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:50.425995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:50.426574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:50.426574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:50.427927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:50.432910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1f22-b74a-445c-af41-8fef11d84e98 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:50.433340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1f22-b74a-445c-af41-8fef11d84e98 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:50.433454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1f22-b74a-445c-af41-8fef11d84e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:50.487774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:50.511892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-21ff1f22-b74a-445c-af41-8fef11d84e98 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:50.513092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-21ff1f22-b74a-445c-af41-8fef11d84e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:50.732262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:50.888772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:50.890330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:51.038187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e031f9-7b87-4a22-bd99-4254d62a6ac6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:51.051296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:51.152227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:51.153729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:51.154056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:51.154334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:51.155959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:51.244632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:51.246942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44586397-aec4-436f-893c-f5a4885aba8c service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:51.264900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 717/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:52.142189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:52.142724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:52.142724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:52.144157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:52.149170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078db34-9718-4d5f-9cc4-b20c0c52c4ec None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:52.149609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078db34-9718-4d5f-9cc4-b20c0c52c4ec None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:52.149718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078db34-9718-4d5f-9cc4-b20c0c52c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:52.169932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:52.225874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5078db34-9718-4d5f-9cc4-b20c0c52c4ec None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:52.227085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5078db34-9718-4d5f-9cc4-b20c0c52c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:52.322570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:52.471148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:52.472658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:52.581728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:52.617692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287003a9-d59b-42c9-979e-82622ce69fc6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:52.728602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:52.729216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:52.729496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:52.729766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:52.731408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:52.806381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:52.819972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:52.821555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eb55b-9f02-4678-a2ce-a397c701b5ea service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:52.840746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 707/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:53.690147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:53.690701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:53.690701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:53.692067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:53.697064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e795-df90-4720-a609-e796c1cf32c4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:53.697512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e795-df90-4720-a609-e796c1cf32c4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:53.697622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e795-df90-4720-a609-e796c1cf32c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:53.776317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c623e795-df90-4720-a609-e796c1cf32c4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:53.777539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c623e795-df90-4720-a609-e796c1cf32c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:53.872407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:54.022998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:54.024436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:54.108039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:54.168995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40568d5-c479-40bf-9cd1-3a15ff1e2422 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:54.279860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:54.280408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:54.280692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:54.280969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:54.282626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:54.331295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:54.376028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:54.377625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf282a-15e8-4370-a2d9-b5060765b997 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:54.395279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 720/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:55.201932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095303f5-500c-46ba-adde-5353509da154 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:55.202522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095303f5-500c-46ba-adde-5353509da154 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:55.202522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095303f5-500c-46ba-adde-5353509da154 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:55.204056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:55.208990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353f4d-590f-45b3-93fa-f41a9769a52d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:55.209426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353f4d-590f-45b3-93fa-f41a9769a52d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:55.209547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353f4d-590f-45b3-93fa-f41a9769a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:55.286290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-57353f4d-590f-45b3-93fa-f41a9769a52d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:55.287513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-57353f4d-590f-45b3-93fa-f41a9769a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:55.384714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:55.536087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095303f5-500c-46ba-adde-5353509da154 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:55.537610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-095303f5-500c-46ba-adde-5353509da154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:55.588043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:55.689833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095303f5-500c-46ba-adde-5353509da154 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:55.802091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:55.802706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:55.802990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:55.803264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:55.804889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:55.811858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:55.895373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:55.896958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9a1c-26f0-4500-b574-1b9878ac1c81 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:55.915110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 710/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:56.723359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:56.723923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:56.723923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:56.725268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:56.730358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cda-0835-4a9f-ac1e-b50efc63d2b9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:56.730825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cda-0835-4a9f-ac1e-b50efc63d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:56.730939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61cda-0835-4a9f-ac1e-b50efc63d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:56.807026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2db61cda-0835-4a9f-ac1e-b50efc63d2b9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:56.808845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2db61cda-0835-4a9f-ac1e-b50efc63d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:56.875564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:56.904568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:57.058365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:57.059892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:57.077734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:57.205020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160464a-e63b-44d5-9130-fa99126c4b42 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:57.290992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:57.316640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:57.317268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:57.317552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:57.317851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:57.319472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:57.408891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:57.410534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270050-86c0-4e70-925b-8726142202c7 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:57.428195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 723/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:58.225557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:58.226160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:58.226160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:58.227495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:58.232956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1591-663e-4433-a5d1-3081b8578003 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:58.233396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1591-663e-4433-a5d1-3081b8578003 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:58.233502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1591-663e-4433-a5d1-3081b8578003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:58.309847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fa1e1591-663e-4433-a5d1-3081b8578003 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:58.310986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fa1e1591-663e-4433-a5d1-3081b8578003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:58.351911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:58.407245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:44:58.555198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:44:58.556714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:58.703073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6a69-4229-4415-b3b4-12020b09dff3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:44:58.756897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:58.817630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:44:58.818274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:58.818555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:58.818829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:58.820444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:58.909356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:44:58.910973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29ca13-52b0-4378-82e3-a92b1905cabe service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:44:58.928722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 713/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:59.724834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136e055-4470-4383-b434-47341f671a00 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:59.725392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136e055-4470-4383-b434-47341f671a00 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:59.725392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136e055-4470-4383-b434-47341f671a00 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:59.726786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:44:59.732160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4d65-7dde-4c6c-82dc-6f047a1cd3e9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:44:59.732573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4d65-7dde-4c6c-82dc-6f047a1cd3e9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:44:59.732701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4d65-7dde-4c6c-82dc-6f047a1cd3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:44:59.808029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1e1b4d65-7dde-4c6c-82dc-6f047a1cd3e9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:44:59.809313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1e1b4d65-7dde-4c6c-82dc-6f047a1cd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:44:59.811444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:59.909077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:00.058479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136e055-4470-4383-b434-47341f671a00 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:00.060171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7136e055-4470-4383-b434-47341f671a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:00.203409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136e055-4470-4383-b434-47341f671a00 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:00.229353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:00.322006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:00.322636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:00.322919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:00.323195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:00.324878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:00.412878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:00.414516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820ef6e-b7a3-4e6b-9375-8caa6f82877e service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:00.432785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 726/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:02.382898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:02.383490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:02.383490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:02.384843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:02.391098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb91b0-c2b3-4e61-bf29-e853735debf5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:02.391578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb91b0-c2b3-4e61-bf29-e853735debf5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:02.391803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb91b0-c2b3-4e61-bf29-e853735debf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:02.443435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:02.476431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-68bb91b0-c2b3-4e61-bf29-e853735debf5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:02.477651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-68bb91b0-c2b3-4e61-bf29-e853735debf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:02.588706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:02.630935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:02.632502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:02.737415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40072-a446-4790-a85b-08aebb95c9b7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:02.770779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:02.813196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:02.813827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:02.814127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:02.814403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:02.816033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:02.929200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:02.930667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679acb-37cd-4394-a6b0-f251097bcf8e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:02.948692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 716/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:05.109559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12dc8-236c-419b-b014-351521af583b None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:05.110108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12dc8-236c-419b-b014-351521af583b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:05.110228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12dc8-236c-419b-b014-351521af583b None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:05.111532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:05.116946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b602f0-8331-4ad0-ba5d-5e4ef296a146 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:05.117349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b602f0-8331-4ad0-ba5d-5e4ef296a146 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:05.117500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b602f0-8331-4ad0-ba5d-5e4ef296a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:05.184376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-93b602f0-8331-4ad0-ba5d-5e4ef296a146 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:05.185630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-93b602f0-8331-4ad0-ba5d-5e4ef296a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:05.199534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:05.286505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:05.325416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12dc8-236c-419b-b014-351521af583b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:05.327031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f5b12dc8-236c-419b-b014-351521af583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:05.428694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12dc8-236c-419b-b014-351521af583b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:05.441108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:05.501714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:05.502349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:05.502630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:05.502903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:05.504501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:05.611777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:05.613401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e87d0-eed1-4062-8b21-479d4e48f434 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:05.632412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 729/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:07.959361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:07.959945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:07.959945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:07.961262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:07.967495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8af6-dab6-4f48-bc9d-ffde06e959a2 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:07.967897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8af6-dab6-4f48-bc9d-ffde06e959a2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:07.968131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8af6-dab6-4f48-bc9d-ffde06e959a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:08.017239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:08.035951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-589b8af6-dab6-4f48-bc9d-ffde06e959a2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:08.037182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-589b8af6-dab6-4f48-bc9d-ffde06e959a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:08.133233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:08.171483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:08.173070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:08.278964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54757c55-e749-4da5-99f4-57e7ba938654 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:08.318977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:08.353508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:08.354143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:08.354936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:08.355271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:08.356859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:08.463389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:08.464876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d56ad-13b7-4b6d-a831-304a6bf24c7e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:08.483018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 719/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:10.590188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:10.590793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:10.590793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:10.592077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:10.597490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db0ef-e38d-4527-8005-0343218ca193 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:10.597972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db0ef-e38d-4527-8005-0343218ca193 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:10.598077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db0ef-e38d-4527-8005-0343218ca193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:10.664880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ee1db0ef-e38d-4527-8005-0343218ca193 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:10.666104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ee1db0ef-e38d-4527-8005-0343218ca193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:10.690000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:10.767376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:10.806307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:10.807888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:10.911619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33673abb-8b18-428a-bfe3-3ba90475cafc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:10.931663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:10.987937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:10.988647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:10.988929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:10.989200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:10.990883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:11.103364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:11.105008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a421-a3bd-451e-8304-9cc249868fed service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:11.128712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 732/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:13.173789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:13.174412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:13.174412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:13.175699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:13.180944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98857ee-dfa3-45fb-bb91-9ae105abc793 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:13.181356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98857ee-dfa3-45fb-bb91-9ae105abc793 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:13.181505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98857ee-dfa3-45fb-bb91-9ae105abc793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:13.245956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:13.248813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b98857ee-dfa3-45fb-bb91-9ae105abc793 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:13.250684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b98857ee-dfa3-45fb-bb91-9ae105abc793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:13.347666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:13.386497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:13.388053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:13.489391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa927b6-47ec-426b-b6ce-6ec7bf8d80d2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:13.538551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:13.563695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:13.564310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:13.564620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:13.564898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:13.566552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:13.674753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:13.676094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b84b2-52d9-4641-89d6-34bacb64bbf7 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:13.694882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 722/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:15.790208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:15.790756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:15.790756 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:15.792777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:15.798258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982d97b-c644-4de4-9ff0-b624e8229c9b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:15.798729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982d97b-c644-4de4-9ff0-b624e8229c9b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:15.798824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982d97b-c644-4de4-9ff0-b624e8229c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:15.865952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4982d97b-c644-4de4-9ff0-b624e8229c9b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:15.867163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4982d97b-c644-4de4-9ff0-b624e8229c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:15.896894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:15.964527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:16.003080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:16.004658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:16.110134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f14bb-fecd-4e37-8228-19351f99bbd7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:16.258611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:16.304801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:16.305330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:16.305609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:16.305913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:16.308288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:16.415104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:16.416898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef338-98cc-4fb9-ae41-bcf1621d0b15 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:16.435180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 735/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:18.507045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:18.507611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:18.507611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:18.509000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:18.514784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad638-22f4-4b2a-8f71-958bdbe42e37 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:18.515288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad638-22f4-4b2a-8f71-958bdbe42e37 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:18.515391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad638-22f4-4b2a-8f71-958bdbe42e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:18.579870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-077ad638-22f4-4b2a-8f71-958bdbe42e37 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:18.581112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-077ad638-22f4-4b2a-8f71-958bdbe42e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:18.590029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:18.677454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:18.716056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:18.717584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:18.822002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f414460-b67f-4430-a412-c80cfc838248 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:18.879712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:18.897924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:18.898542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:18.898820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:18.899092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:18.900697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:19.008071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:19.009591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eae01-d8db-4571-8103-59ab39297f6e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:19.027473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 725/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:21.124255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:21.124789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:21.124898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:21.126254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:21.131313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095663-bac9-477a-9872-53dacc1e1b93 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:21.131710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095663-bac9-477a-9872-53dacc1e1b93 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:21.131863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095663-bac9-477a-9872-53dacc1e1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:21.199335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-85095663-bac9-477a-9872-53dacc1e1b93 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:21.200535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-85095663-bac9-477a-9872-53dacc1e1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:21.243284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:21.301776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:21.340077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:21.341627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:21.443735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8a4a-5bd7-469c-99a8-cf2a0f341213 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:21.481190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:21.518353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:21.518967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:21.519250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:21.519524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:21.521141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:21.628365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:21.629978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d614572-de8e-4cb3-81cd-48689e42e77c service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:21.648043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 738/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:23.675061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:23.675613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:23.675613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:23.676965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:23.682444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191ac6-9e52-4f4d-b082-c84f62e264da None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:23.682860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191ac6-9e52-4f4d-b082-c84f62e264da None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:23.682996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191ac6-9e52-4f4d-b082-c84f62e264da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:23.749764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ec191ac6-9e52-4f4d-b082-c84f62e264da None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:23.750996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ec191ac6-9e52-4f4d-b082-c84f62e264da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:23.769284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:23.848541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:23.885874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:23.887436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:23.990230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99d1cb-01af-4922-8be4-b7710b99d3d1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:24.057675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:24.064742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:24.065346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:24.065623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:24.065921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:24.067599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:24.176830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:24.178297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f4aab-ec80-424a-898b-10048cdd514b service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:24.196639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 728/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:26.203162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:26.203765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:26.203765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:26.205122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:26.210294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf929-80ac-4649-988c-a4bdb9eec2fd None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:26.210706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf929-80ac-4649-988c-a4bdb9eec2fd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:26.210851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf929-80ac-4649-988c-a4bdb9eec2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:26.276944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e4dcf929-80ac-4649-988c-a4bdb9eec2fd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:26.278280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e4dcf929-80ac-4649-988c-a4bdb9eec2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:26.326213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:26.376890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:45:26.414005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:26.415577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:26.517958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0e00-fb3d-4ccb-8550-6a0e53c74bb7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:26.565588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:26.592655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:26.593205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:26.593486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:26.593757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:26.595411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:26.709871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:26.711614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359cc8-7763-4e5b-acb7-eeb9e8a78c0e service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:26.730185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 741/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:36.375056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=22 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:36.728333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=66 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:46.160604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455ea3-96a5-4c43-94fb-3b8fdbc8cbae None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:46.161194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455ea3-96a5-4c43-94fb-3b8fdbc8cbae None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:46.161194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455ea3-96a5-4c43-94fb-3b8fdbc8cbae None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:46.162529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 730/1471] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:46.168245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516b1a-139a-451e-8092-e0812884915a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:46.168679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516b1a-139a-451e-8092-e0812884915a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:46.168815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516b1a-139a-451e-8092-e0812884915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:46.234063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a5516b1a-139a-451e-8092-e0812884915a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:46.235276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a5516b1a-139a-451e-8092-e0812884915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:46.330943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 742/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:46.413627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:46.413972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:46.414250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:46.415575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 731/1473] 10.222.0.47 () {54 vars in 966 bytes} [Tue Jul 26 12:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:46.420855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a8b-5895-4939-83ef-b8a973abe5ac None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:46.421152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a8b-5895-4939-83ef-b8a973abe5ac None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:46.421432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a8b-5895-4939-83ef-b8a973abe5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:46.496634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5ee68a8b-5895-4939-83ef-b8a973abe5ac None None] MFA Rules not processed for user `6c2579707a174cd3ba2d235e6ec548bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:46.497854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ee68a8b-5895-4939-83ef-b8a973abe5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:46.517983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:46.575578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 743/1474] 10.222.0.47 () {58 vars in 1063 bytes} [Tue Jul 26 12:45:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:46.583182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:46.584618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:46.690267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6aff-20d5-471f-a6af-997e65f07a47 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:46.764373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:46.764987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:46.765385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:46.765664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:46.767314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:46.820894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:46.878985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:46.880448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0c9d8-2b98-4016-9a97-f1e23409c119 service glance] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:46.900172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 732/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:48.979086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:48.979666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:48.979666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:48.981047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 744/1476] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:48.986289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443a48-937d-4bd5-bb9c-3bf27a5feaad None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:48.986676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443a48-937d-4bd5-bb9c-3bf27a5feaad None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:48.986839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443a48-937d-4bd5-bb9c-3bf27a5feaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:49.053513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b0443a48-937d-4bd5-bb9c-3bf27a5feaad None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:49.054806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b0443a48-937d-4bd5-bb9c-3bf27a5feaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:49.151883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 733/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:49.174615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:49.176228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:49.299678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954899-6f24-48cc-aa74-747d30b0862d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:49.348354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:49.393541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:49.394190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:49.394472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:49.394746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:49.395443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:49.397190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:45:49.397190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:45:49.397190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:45:49.398404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ad902-07ea-4fa0-bcb0-fdf74dd0a6df admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:49.417083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 745/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Jul 26 12:45:49 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:45:51.443096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:51.443686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:51.443686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:51.445988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 734/1479] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:51.451075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3e3b-76af-4a76-ab0c-6c7f1b284046 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:51.451477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3e3b-76af-4a76-ab0c-6c7f1b284046 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:51.451640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3e3b-76af-4a76-ab0c-6c7f1b284046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:51.518853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d0bd3e3b-76af-4a76-ab0c-6c7f1b284046 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:51.520061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d0bd3e3b-76af-4a76-ab0c-6c7f1b284046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:51.615059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 746/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:51.658475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:51.659988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:51.669894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:51.806544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cccbf-8470-44e6-a8c0-dca7838e4244 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:51.886208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:51.918532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:51.919140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:51.919418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:51.919695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:51.921290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:52.010019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:52.011585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd9ba3-3997-4c6a-a09d-126f106176d0 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:52.029665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 735/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:54.210658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:54.211300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:54.211300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:54.212577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 747/1482] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:54.217775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa709182-60e9-4d3b-82d0-f9b1ece70625 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:54.218200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa709182-60e9-4d3b-82d0-f9b1ece70625 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:54.218358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa709182-60e9-4d3b-82d0-f9b1ece70625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:54.284523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-aa709182-60e9-4d3b-82d0-f9b1ece70625 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:54.285715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa709182-60e9-4d3b-82d0-f9b1ece70625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:54.332022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:54.383657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 736/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:54.419737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:54.421368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:54.445160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:54.523523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be052b8-c6d9-4e32-931c-97f25214c384 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:54.598715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:54.599248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:54.599529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:54.599803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:54.602584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:54.676903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:54.711835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:54.713259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a79fa-a220-4d7b-b45d-e627ceae4d3c service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:54.731267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 748/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:56.775904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:56.776500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:56.776500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:56.777825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 737/1485] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:45:56.783078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6f68-36ac-4812-985e-e3fe264d28dd None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:56.783475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6f68-36ac-4812-985e-e3fe264d28dd None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:56.783628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6f68-36ac-4812-985e-e3fe264d28dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:56.848993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9ebc6f68-36ac-4812-985e-e3fe264d28dd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:56.850229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9ebc6f68-36ac-4812-985e-e3fe264d28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:56.945671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 749/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:45:56.982834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:56.984349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:57.089375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618cabd-0988-414a-b59e-d4ff9e72d799 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:57.161140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:57.163075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:57.164371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:57.164860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:57.165322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:57.167220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:57.276008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:57.277365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833c7e3-0a68-40f1-b54e-3a6cf7d945df service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:57.296287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 738/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:45:59.375527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:59.376104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:59.376104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:59.377759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 750/1488] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:45:59.383649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f138df-48ba-48f6-9ca8-fe8920cccd07 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:59.384084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f138df-48ba-48f6-9ca8-fe8920cccd07 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:59.384206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f138df-48ba-48f6-9ca8-fe8920cccd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:59.455504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f4f138df-48ba-48f6-9ca8-fe8920cccd07 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:45:59.456690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f4f138df-48ba-48f6-9ca8-fe8920cccd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:59.511474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:59.557214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 739/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:45:59.601402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:45:59.603585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:59.640317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:59.709437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300a50c-1bff-4a81-9c24-9878bdfad369 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:45:59.783251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:45:59.783884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:45:59.784196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:45:59.784478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:45:59.786194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:45:59.865749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:59.896461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:45:59.898023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33a760-0661-4d40-a046-f1c8ea04523d service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:45:59.917365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 751/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:46:02.103727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:46:02.104381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:46:02.104539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:46:02.105936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 740/1491] 10.222.0.47 () {54 vars in 926 bytes} [Tue Jul 26 12:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:46:02.111562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2dfe-df47-4731-9799-16587875a37e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:46:02.112017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2dfe-df47-4731-9799-16587875a37e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:46:02.112120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2dfe-df47-4731-9799-16587875a37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:46:02.195319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-133f2dfe-df47-4731-9799-16587875a37e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:46:02.196539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-133f2dfe-df47-4731-9799-16587875a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:46:02.301394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 752/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Tue Jul 26 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:46:02.342727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:46:02.344240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:46:02.466695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fababf64-8e55-464b-8a61-61f6aade5634 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:46:02.547366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:46:02.547983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:46:02.548262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:46:02.548536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:46:02.550198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:46:02.560661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:46:02.671015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:46:02.672451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb6cb2-6e8c-4b29-97a3-37f05fe36d63 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:46:02.691247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 741/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:46:12.298742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=82 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:46:12.688871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=50 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:31.169783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:31.170371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:31.170371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:31.244986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:47:31.246208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:31.341772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 753/1494] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:47:31.351814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:31.352331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:31.352459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:31.429007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:47:31.430181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:31.527961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 742/1495] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:47:31.533207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:31.534446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:31.545883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c57b-efd4-4e49-afe7-6759979e60e6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:31.606527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:31.640794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:31.641426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:31.642283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:31.642561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:31.643259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:47:31.643567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:31.644584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:31.644584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:47:31.644584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:47:31.645474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:31.656511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 754/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:47:31.665227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:31.674653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43b43d-bf65-4a73-a87f-a7432f885cd9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:31.735430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:31.771306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:31.771916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:31.772195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:31.772465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:31.773133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:31.774886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:31.774886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:47:31.774886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:47:31.776078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:31.831810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 743/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:47:31 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:47:31.835674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:31.837305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:31.871771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75533c9c-72d5-43f0-b459-48ad9fd40f5a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:31.965694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:31.966337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:31.966622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:31.966898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:31.967554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:31.968568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:31.968568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:47:31.968568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:47:31.969784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:32.012843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 755/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:47:31 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:47:32.017504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:32.019074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.081923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd5db-269f-4481-a7f4-a39186126f4f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:32.164282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:32.176357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:32.176963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.177238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.177506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.178252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:32.179245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:32.179245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:47:32.179245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:47:32.180122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:32.192996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 744/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:47:32.197076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:32.198629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.210458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6a04a-6ab4-4350-bdbc-7c3697de4f9d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:32.235089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:32.307885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:32.308426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.308704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.308975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.309665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:32.310736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:32.310736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:47:32.310736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:47:32.311614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cf523-e67b-4a0e-bb50-bf8388af944a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:32.324782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 756/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:47:32.328872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:32.330433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.364440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e4ea-a384-4c07-8f3c-ba40e074adb8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:32.460727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:32.461395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.461675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.461978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] PATH_INFO: `/v3/projects/aab6b9dd87b94acd8ef4d3815877c147/users/3b2b298cf9e64ff69dd53838a6cd5e61/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.484403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab6b9dd87b94acd8ef4d3815877c147, user_id=3b2b298cf9e64ff69dd53838a6cd5e61, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:32.486255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:32.486255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:47:32.486255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:47:32.488193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de5cf5-be5f-413c-a660-ebb6adc1182d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:32.512816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 745/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:47:32 2022] PUT /identity/v3/projects/aab6b9dd87b94acd8ef4d3815877c147/users/3b2b298cf9e64ff69dd53838a6cd5e61/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:47:32.524712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e915-62ac-4bee-9ab8-f389e4190151 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.525006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e915-62ac-4bee-9ab8-f389e4190151 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.525286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e915-62ac-4bee-9ab8-f389e4190151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.581635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1b79e915-62ac-4bee-9ab8-f389e4190151 None None] MFA Rules not processed for user `3b2b298cf9e64ff69dd53838a6cd5e61`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:47:32.582877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b79e915-62ac-4bee-9ab8-f389e4190151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.660500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 757/1502] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:47:32.674110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.674404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.674687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.676037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 746/1503] 10.222.0.47 () {54 vars in 964 bytes} [Tue Jul 26 12:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:47:32.680823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a3a9-973b-4c11-863a-29578a561de0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:32.681115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a3a9-973b-4c11-863a-29578a561de0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:32.681393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a3a9-973b-4c11-863a-29578a561de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:32.712603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:32.758258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7fe1a3a9-973b-4c11-863a-29578a561de0 None None] MFA Rules not processed for user `2135e982052e41cc834c5c0a6608decc`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:47:32.759473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7fe1a3a9-973b-4c11-863a-29578a561de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.834748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 758/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Jul 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:47:32.843467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:32.845621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:32.896104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:32.950990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34516a-2b98-40ab-b30c-517f1c2c7790 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:33.024254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:33.024865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:33.025147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:33.025422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:33.027078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:33.129043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:33.130517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:33.133989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:33.149017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 747/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:47:33.195681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261be2f-f4d4-4c2f-a6e6-2a14789a442e None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:33.195972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261be2f-f4d4-4c2f-a6e6-2a14789a442e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:33.196248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261be2f-f4d4-4c2f-a6e6-2a14789a442e None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:33.197514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 759/1506] 10.222.0.47 () {52 vars in 830 bytes} [Tue Jul 26 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:47:33.200984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:33.202212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:33.301800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f94269-7c9e-4830-a32c-5388723fc9a3 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:33.397863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:33.398548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:33.398700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:33.398978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] PATH_INFO: `/v3/users/3b2b298cf9e64ff69dd53838a6cd5e61` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:33.411391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2b298cf9e64ff69dd53838a6cd5e61)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:33.412416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:33.412416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:47:33.412416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:47:33.413628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:33.423556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:33.478262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2b298cf9e64ff69dd53838a6cd5e61'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:33.487780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2b298cf9e64ff69dd53838a6cd5e61'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:33.488237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2b298cf9e64ff69dd53838a6cd5e61'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:33.501458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2b298cf9e64ff69dd53838a6cd5e61'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:33.519529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2b298cf9e64ff69dd53838a6cd5e61'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:33.525103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 748/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:47:33 2022] DELETE /identity/v3/users/3b2b298cf9e64ff69dd53838a6cd5e61 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:47:33.529561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:33.529896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:33.530178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:33.587158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:47:33.588365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:33.662929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:33.676789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 760/1508] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:47:33.686356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:33.687643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:33.787334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb05df-1269-4f04-ac4c-962620dcb3cb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:33.841738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:33.863516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:33.864429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:33.864710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:33.864985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:33.866638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:33.974150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:33.975497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20488852-141f-4571-8a8b-6401ee65620b service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:33.994685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 749/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:47:34.357035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:47:34.358316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:47:34.370081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643da88-5a08-4a86-b1c6-da7a7dae153e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:47:34.484679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:47:34.485331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:47:34.485617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:47:34.485911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] PATH_INFO: `/v3/projects/aab6b9dd87b94acd8ef4d3815877c147` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:47:34.497065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab6b9dd87b94acd8ef4d3815877c147)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:47:34.498152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:47:34.498152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:47:34.498152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:47:34.499621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:47:34.558590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab6b9dd87b94acd8ef4d3815877c147', 'request_id': 'req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:34.572362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab6b9dd87b94acd8ef4d3815877c147', 'request_id': 'req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:34.583114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab6b9dd87b94acd8ef4d3815877c147', 'request_id': 'req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:34.604984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] The token cache is being invalidate because project aab6b9dd87b94acd8ef4d3815877c147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:47:34.605271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:34.605699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c24a4d30-0eaa-4489-a4d4-c9ca088bac60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:47:34.607134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 761/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:47:34 2022] DELETE /identity/v3/projects/aab6b9dd87b94acd8ef4d3815877c147 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:47:43.992451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=62 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:47:44.603062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:20.887360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:20.887994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:20.887994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:20.889641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:20.894607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8112d-f812-4a28-a813-c69c56b4b4a3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:20.895033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8112d-f812-4a28-a813-c69c56b4b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:20.895163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8112d-f812-4a28-a813-c69c56b4b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:20.979953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-36f8112d-f812-4a28-a813-c69c56b4b4a3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:20.981153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-36f8112d-f812-4a28-a813-c69c56b4b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:21.087854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:21.241460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:21.243619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:21.364230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97e28-c829-416c-9fa6-44c61fc4fa67 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:21.369658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:21.370293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:21.370571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:21.370846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:21.379009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:21.380575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ab681-c23f-4b8e-a94e-2d0d574174fe service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:21.390557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 751/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:22.221660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3a97-aa00-483b-83de-b3bd8ec64215 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:22.222322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3a97-aa00-483b-83de-b3bd8ec64215 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:22.222322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3a97-aa00-483b-83de-b3bd8ec64215 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:22.223613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:22.228331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a77c5-4611-4778-9353-e0d5624e74c7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:22.228729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a77c5-4611-4778-9353-e0d5624e74c7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:22.228902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a77c5-4611-4778-9353-e0d5624e74c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:22.248466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-696a77c5-4611-4778-9353-e0d5624e74c7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:22.249684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-696a77c5-4611-4778-9353-e0d5624e74c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:22.257419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:22.409650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c3a97-aa00-483b-83de-b3bd8ec64215 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:22.424407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c3a97-aa00-483b-83de-b3bd8ec64215 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:22.429884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:22.430497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:22.430782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:22.431062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:22.439418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:22.441121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f90f1d-2f4e-4a5a-b30f-368850b96d2b service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:22.450796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 764/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:22.834868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86782-7d68-4676-a82a-e8dce5002ed7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:22.835161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86782-7d68-4676-a82a-e8dce5002ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:22.835445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c86782-7d68-4676-a82a-e8dce5002ed7 None None] PATH_INFO: `/v3` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:22.836742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 753/1517] 10.222.0.43 () {54 vars in 925 bytes} [Tue Jul 26 12:49:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:49:22.846000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3879-f2ec-493f-8f44-1b74900876d1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:22.846298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3879-f2ec-493f-8f44-1b74900876d1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:22.846582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3879-f2ec-493f-8f44-1b74900876d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:22.906586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c58d3879-f2ec-493f-8f44-1b74900876d1 None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:22.907792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c58d3879-f2ec-493f-8f44-1b74900876d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:22.924893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:22.978892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 765/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 26 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:31.944180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070510a-f222-4452-b078-0a21d5c765fe None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:31.944781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070510a-f222-4452-b078-0a21d5c765fe None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:31.944889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070510a-f222-4452-b078-0a21d5c765fe None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:31.946227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 754/1519] 10.222.0.47 () {54 vars in 961 bytes} [Tue Jul 26 12:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:31.951316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b79c-f189-4021-b99d-d94e9511f93e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:31.951777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b79c-f189-4021-b99d-d94e9511f93e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:31.951913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b79c-f189-4021-b99d-d94e9511f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:31.971388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5401b79c-f189-4021-b99d-d94e9511f93e None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:31.972726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5401b79c-f189-4021-b99d-d94e9511f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:31.981036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 766/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Jul 26 12:49:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:31.989126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070510a-f222-4452-b078-0a21d5c765fe None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:32.002754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070510a-f222-4452-b078-0a21d5c765fe None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:32.007539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:32.008129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:32.008406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:32.008678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:32.019119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:32.022015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1003b1-e636-4a78-9d1d-68982c4b9aea service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:32.034755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 755/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:33.673196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f27e-3cf0-4e57-8ac3-f1158658ee4c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:33.673770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f27e-3cf0-4e57-8ac3-f1158658ee4c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:33.673917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0f27e-3cf0-4e57-8ac3-f1158658ee4c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:33.675247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:33.679900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b9790-d0c1-45b0-81d4-d800a5812949 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:33.680316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b9790-d0c1-45b0-81d4-d800a5812949 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:33.680460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b9790-d0c1-45b0-81d4-d800a5812949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:33.699554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-bd2b9790-d0c1-45b0-81d4-d800a5812949 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:33.701479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bd2b9790-d0c1-45b0-81d4-d800a5812949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:33.709276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:33.865183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0f27e-3cf0-4e57-8ac3-f1158658ee4c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:33.880142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0f27e-3cf0-4e57-8ac3-f1158658ee4c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:33.885585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:33.886224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:33.886507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:33.886786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:33.895561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:33.897138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21db5-1906-4354-9727-78f3d43667ec service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:33.906538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 768/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:34.724638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af979ce-0e7a-4722-9840-db12e958f4b2 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:34.725211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af979ce-0e7a-4722-9840-db12e958f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:34.725211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af979ce-0e7a-4722-9840-db12e958f4b2 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:34.726640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 12:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:34.731586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868845-80f0-4ec8-beee-77ed72090030 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:34.732490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868845-80f0-4ec8-beee-77ed72090030 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:34.732490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868845-80f0-4ec8-beee-77ed72090030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:34.752658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d8868845-80f0-4ec8-beee-77ed72090030 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:34.753879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d8868845-80f0-4ec8-beee-77ed72090030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:34.761775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:34.913865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af979ce-0e7a-4722-9840-db12e958f4b2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:34.928961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af979ce-0e7a-4722-9840-db12e958f4b2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:34.934489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:34.935864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:34.936141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:34.936413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:34.944502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:34.946101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff11167-e287-4b3c-975f-535bd3c93d7f service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:34.955540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 758/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:38.683978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:38.684557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:38.684908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:38.686455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:38.691697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9c30-e2a4-4dc9-803a-079067530be7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:38.692124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9c30-e2a4-4dc9-803a-079067530be7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:38.692254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9c30-e2a4-4dc9-803a-079067530be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:38.711812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d3aa9c30-e2a4-4dc9-803a-079067530be7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:38.713003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d3aa9c30-e2a4-4dc9-803a-079067530be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:38.721946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:38.891687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:38.893464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:38.971356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df562-ceff-4770-8fc9-f2f844720e2f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:38.974901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:38.975516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:38.975800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:38.976075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:38.985595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:38.987325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eb99d-5d3a-46ea-a665-8b72f5bf80e9 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:38.996610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 771/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:40.993370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:40.993972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:40.993972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:40.995318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:41.001440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38244578-e823-4b7a-8224-ba31cf02c37b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:41.001903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38244578-e823-4b7a-8224-ba31cf02c37b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:41.002051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38244578-e823-4b7a-8224-ba31cf02c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:41.022054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-38244578-e823-4b7a-8224-ba31cf02c37b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:41.023269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-38244578-e823-4b7a-8224-ba31cf02c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:41.031331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:41.069750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:41.071443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:41.084712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aed1f-84ca-4172-957e-05e79b20f28c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:41.088150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:41.088745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:41.089025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:41.089296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:41.098341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:41.099744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e628-94db-40a0-a889-52e21a8ba7b9 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:41.109569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 761/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:49:44.670980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:44.671545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:44.671545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:44.672881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:44.678014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ee95-2190-4a86-abe2-857e89740aab None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:44.678463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ee95-2190-4a86-abe2-857e89740aab None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:44.678574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ee95-2190-4a86-abe2-857e89740aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:44.686639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=81 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:44.699110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0179ee95-2190-4a86-abe2-857e89740aab None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:44.700226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0179ee95-2190-4a86-abe2-857e89740aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:44.708875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:49:45.016305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:45.018002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:45.082153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:45.096017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c850c-4554-4043-9b30-ed8913744df0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:45.099704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:45.100363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:45.100651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:45.100930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:45.111505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:45.113232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ced0cd-3b79-42b0-8aae-938559a3bf11 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:45.122789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 774/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:47.185464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:47.186564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:47.186564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:47.187903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 12:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:49:47.193570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899dbf1-669b-4dd0-a56a-a915e5e44543 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:47.194024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899dbf1-669b-4dd0-a56a-a915e5e44543 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:47.194142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899dbf1-669b-4dd0-a56a-a915e5e44543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:47.214183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c899dbf1-669b-4dd0-a56a-a915e5e44543 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:49:47.215368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c899dbf1-669b-4dd0-a56a-a915e5e44543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:47.223437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:49:47.526921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:49:47.528601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:49:47.541620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502653e3-71c3-452e-aaef-f302e2e13090 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:49:47.545912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:49:47.546526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:49:47.546809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:49:47.547084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:49:47.556172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:49:47.557593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c378-38cb-4543-9bd7-4fc876b7209b service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:49:47.567739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 764/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:49:57.209172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=11 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:57.563557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=8 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:23.958951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb2a1-19da-4c0a-b113-a4a7b29bce5a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:23.959618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb2a1-19da-4c0a-b113-a4a7b29bce5a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:23.959618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb2a1-19da-4c0a-b113-a4a7b29bce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:23.987093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-bbceb2a1-19da-4c0a-b113-a4a7b29bce5a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:23.988340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bbceb2a1-19da-4c0a-b113-a4a7b29bce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:23.997416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 776/1540] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.006124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ce3-ed47-42a7-ab2c-4b71ea6991ab None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.006703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ce3-ed47-42a7-ab2c-4b71ea6991ab None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.006703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ce3-ed47-42a7-ab2c-4b71ea6991ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.030330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.030668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.030901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.060300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f7c23ce3-ed47-42a7-ab2c-4b71ea6991ab None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.061559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f7c23ce3-ed47-42a7-ab2c-4b71ea6991ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.079176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.080441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.087512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 765/1541] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.088869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038d48-630c-4ffa-a8ea-48d4106af7b7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.089157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038d48-630c-4ffa-a8ea-48d4106af7b7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.089705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038d48-630c-4ffa-a8ea-48d4106af7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.128064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 777/1542] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.128933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.154874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ce562-f8b1-47c6-bb99-9a9b4d658ae9 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.162457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e0038d48-630c-4ffa-a8ea-48d4106af7b7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.163695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e0038d48-630c-4ffa-a8ea-48d4106af7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.165801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.166532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.166814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.167089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.168728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.169214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.170852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39320a8e-62a4-458f-a46b-99378037e2c5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.191571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 766/1543] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.193166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.193465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.193742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.195539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 778/1544] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.222480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.222684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.222947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.243722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.245084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.266161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 767/1545] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.267014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.280328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.281562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.294370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e434c-f0c5-4d8f-a0e4-fa2445509e7c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.297509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 779/1546] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.298485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.314700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58341-2e3e-44d1-ac78-f28cfafc2d3d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.316854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.317511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.317802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.318112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.318787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.320777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.327198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.327840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.328132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.328400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.329487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.329799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.332312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b9d3-4273-48c4-8b35-0832417a9f92 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.355957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 780/1547] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.357990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51beef14-d105-4184-bb4b-658b04d2ea69 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.358621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51beef14-d105-4184-bb4b-658b04d2ea69 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.359140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51beef14-d105-4184-bb4b-658b04d2ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.377164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 768/1548] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.378131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.383475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-51beef14-d105-4184-bb4b-658b04d2ea69 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.384939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-51beef14-d105-4184-bb4b-658b04d2ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.450268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1f21-004c-47d9-bf7b-e34a742257cb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.456144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 781/1549] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.458066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.458473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.458850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.462288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.463230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.463529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.463817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.465421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.466021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.467167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:24.467167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:51:24.467167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:51:24.468126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e1e7-ffd4-4d5b-a76b-7eb92544577e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.490093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 769/1550] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.490093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.490093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.490093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.491470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.492879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.503543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 782/1551] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.504606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.513066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.514588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.515161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6120a-c9c7-4a54-a77c-6aab9747f354 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.519908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.520531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.520817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.521099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.521765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.522819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:24.522819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:51:24.522819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:51:24.523184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 770/1552] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.523936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.527231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705c149-b9a9-4658-a9de-4689a7ae194b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.534274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0935496-8b83-49d2-9413-bebf77eafe67 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.538990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.539594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.539871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.540142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.540799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.541800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:24.541800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:51:24.541800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:51:24.543722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4024-c7a1-4b4e-b76b-7d8ce47ed96a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.561736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 783/1553] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.561736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798aa00-6b90-42bb-999b-88b06123a75b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.561736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798aa00-6b90-42bb-999b-88b06123a75b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.561736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798aa00-6b90-42bb-999b-88b06123a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.569546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 771/1554] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.569546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.569546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.569546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.582697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6798aa00-6b90-42bb-999b-88b06123a75b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.583917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6798aa00-6b90-42bb-999b-88b06123a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.588876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.590370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.644815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 784/1555] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.646113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d69-5831-42b3-8174-5898be883c2e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.646410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d69-5831-42b3-8174-5898be883c2e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.646693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d69-5831-42b3-8174-5898be883c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.655914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 772/1556] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.657040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.666575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8cee2d69-5831-42b3-8174-5898be883c2e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.666811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949b803-244d-43c2-aac5-18d892648f83 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.667780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8cee2d69-5831-42b3-8174-5898be883c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.671670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.672358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.672720 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.673072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.673831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.675805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dc9-bb5d-4584-b6c0-3fd60b848ef6 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.676154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 785/1557] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.677550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.677894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.678144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.699963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.701293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.701585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:24.709577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 773/1558] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.710143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 786/1559] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.710847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.711136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.711416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.711812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.722977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ff42-d7bc-4b49-9dd9-6ac3d5dd7e9e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.731363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.732571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.732737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:24.783374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.783912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.784196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.784473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.785133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.787067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644cb8-dee2-4d94-8e78-59b094417759 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.791773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 774/1560] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.792634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.802360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baf27a-d9ff-4d8f-942e-c2be5123700d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.808006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.808725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.809006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.809379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.810115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.813763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 787/1561] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.814146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.814251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44d5-44f6-4eb8-8f5d-2fca59c18dce None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.814251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44d5-44f6-4eb8-8f5d-2fca59c18dce None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.814251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f44d5-44f6-4eb8-8f5d-2fca59c18dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.823137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 775/1562] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:24.824494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.832787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fc6f44d5-44f6-4eb8-8f5d-2fca59c18dce None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.833957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0b25-1176-4a11-abac-83a544940db3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.834096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fc6f44d5-44f6-4eb8-8f5d-2fca59c18dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.838745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.839457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.840208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.840483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.841171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.841476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.842865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 788/1563] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.843091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.843993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.844291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.844667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.856659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 776/1564] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.857310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.865775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:24.867106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:24.874397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8da8-64e5-491f-8a67-a21eb0e4a9bd admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.876603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 789/1565] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:24.877439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.880512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.881132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.881413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.881688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.882623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.882928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.884524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.887732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdfe65-4ae3-43f8-8021-121b0ddefc8e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.892412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.893023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.893300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.893573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.894264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.896160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.905467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 777/1566] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.905467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.909297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8920c-4913-40f4-8d11-0b873a8bf2f7 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.915158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.915875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.916301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.916583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.917315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.917748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.919403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 790/1567] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:24.920403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.922471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.929621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b2b-e22d-4098-aacb-20755cfc60b2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.934423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.935026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.935302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.942578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 778/1568] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.942743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.942743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.942952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.943067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.948166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 791/1569] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:24.948293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c517e-e4f2-4ca4-8abf-c05e5e268005 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.950645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.956638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.957254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.957536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.957830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.958540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.960164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.962583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9011-b4ec-4f0e-91ef-db0ce6728c12 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.968438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.969067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.969348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.969622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.970348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:24.970656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.971231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 779/1570] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:24.972390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.974652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.984428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e91f-341c-4c66-a1f4-61c316564a1e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:24.985182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 792/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:24.986194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:24.990383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:24.991081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:24.991281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:24.991757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:24.992429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:24.994491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:24.996897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026c6d-75ec-4247-a6b9-61e84f0cee22 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.001364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.001998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.002282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.002559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.003241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:25.003545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.005114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.018015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 793/1572] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:25.018947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.025903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 780/1573] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:24 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.025903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.035680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9daf17-2055-4ddd-b71a-0b9ba8ba9daf admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.092538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.092764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b16c6-19b6-4253-abfd-8326a9680398 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.093161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.093473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.093839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.094456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.096378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.097453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.098090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.098372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.098651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.099338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.100912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.114316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 781/1574] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.114316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.123141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749b17-c6bf-4956-8aa6-7706695883a5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.127019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 794/1575] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.127783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.128389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.128669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.128941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.129597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.130949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.131593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.142447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.152869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.161203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 782/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.162249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.197962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768136c-36b9-43d9-befc-074992ed57d4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.224320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706508ad-bceb-4535-ad84-6f33e0873c1d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.229011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.229688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.230072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.230379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] PATH_INFO: `/v3/projects/c0ae6201eef44f6bacb5614b4b943392/users/5b9251bed8bf45e6bd43af84a1e6e52f/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.247527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ae6201eef44f6bacb5614b4b943392, user_id=5b9251bed8bf45e6bd43af84a1e6e52f, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.250308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.263607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.264240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.264518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 783/1577] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:25 2022] PUT /identity/v3/projects/c0ae6201eef44f6bacb5614b4b943392/users/5b9251bed8bf45e6bd43af84a1e6e52f/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:25.264642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.264813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.265299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.265571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.267198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.278206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 795/1578] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.279083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.288956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9c87-6198-420f-a955-f1fa4bd95a85 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.333138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e832fd-e1a1-4ba8-b10f-34fdfa43a50a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.337987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.338599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.338884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.339357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.340286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.342225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.345551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.346200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.346488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.346762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.347544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.349428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.371615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 784/1579] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.372542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.381772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 796/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.382700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.433279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.436480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.440261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3db2-3e5c-497f-b3dd-f5968c953e3f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.447588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.448592 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.449367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0227a-ac6d-44aa-8258-b46f77640c62 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.449584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.449905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.450614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.452555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.454881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.455692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.455989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.456269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.456977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.458632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.470268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 797/1581] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.471240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.481412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 785/1582] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.481412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.484223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29976-d762-4964-9166-aefd2f8b256b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.489074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99867-1b67-4a4f-954d-96c0fb1fed50 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.489199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.489750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.490083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.490365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.491076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.492992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b816351-ffbb-47ad-8ea6-f64cdc8ed40b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.493542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.494165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.494446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.494719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.495361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.497493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.516463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 798/1583] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.517751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.518076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.518363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.524208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 786/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.524208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.531841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81f2c-c979-462e-bf61-72c542cd1317 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.536395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.537046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.537326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.537606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] PATH_INFO: `/v3/projects/c79c0831e2e349a085ef3c2275e1101f/users/8245326bacd0477f81fdfdbd86438fef/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.550015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] MFA Rules not processed for user `5b9251bed8bf45e6bd43af84a1e6e52f`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:25.551171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:25.552907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79c0831e2e349a085ef3c2275e1101f, user_id=8245326bacd0477f81fdfdbd86438fef, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.555588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.569300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 787/1585] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:25 2022] PUT /identity/v3/projects/c79c0831e2e349a085ef3c2275e1101f/users/8245326bacd0477f81fdfdbd86438fef/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:25.570104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.616503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 799/1586] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:25.622509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.633067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d9372-ec85-44fd-bb05-3ae3f217111f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.635995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6c12-f485-43f5-84ca-84fc396545b3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.638489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.639111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.639482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.639759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.641203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.641338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.641827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.642581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.642925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.643089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.643770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.645789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.668149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 800/1587] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.669117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.675390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 788/1588] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:25.675390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.680715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418ea86-4605-4f8b-b09d-57b9b07e9a87 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.683882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd87c-201a-4d70-9db3-6bae1d9f69da admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.686202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.686858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.687161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.687435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] PATH_INFO: `/v3/projects/0a3348900ff04f429fb4f531c8ca20b2/users/2d4e33733bd6487daf40c527d13d33e9/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.688559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.689159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.689450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.689873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.690585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.692158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.702427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3348900ff04f429fb4f531c8ca20b2, user_id=2d4e33733bd6487daf40c527d13d33e9, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.705862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 789/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.706029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:25.706029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:51:25.706029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:51:25.706308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.706411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.716187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15148-a600-42db-9b4b-7cd643146730 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.719521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 801/1590] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:25 2022] PUT /identity/v3/projects/0a3348900ff04f429fb4f531c8ca20b2/users/2d4e33733bd6487daf40c527d13d33e9/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:25.720469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.781042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.781687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.782001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.782276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.782967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.783458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5b1b-9a3c-4f27-a3ae-b98e4d95ec9c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.784606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a7dce-b27a-49c5-b034-63ee4e20ef03 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.790504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.791131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.791422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.791753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.793090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.794733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5220-1c05-4fe9-a4f6-992800c5f971 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.798968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 790/1591] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.800289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.800520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.800798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.807583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 802/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.807583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9d58-ed79-4350-9b28-13c843f47dcc None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.807583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9d58-ed79-4350-9b28-13c843f47dcc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.807583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9d58-ed79-4350-9b28-13c843f47dcc None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.809264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 803/1593] 10.222.0.47 () {54 vars in 962 bytes} [Tue Jul 26 12:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:25.814394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb9d58-ed79-4350-9b28-13c843f47dcc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.820840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:25.822068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:25.827003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb9d58-ed79-4350-9b28-13c843f47dcc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.829689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 791/1594] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:25.830656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.831495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.832091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.832371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.832646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.833699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.834946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.841321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.844235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60017ef7-0409-4dc9-a614-75aaa25e8070 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.847200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 804/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.849164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.852324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.852982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.853267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.853543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.854278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.856578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4bb56-dcda-494b-af9c-c90329d405ff admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.859947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9a60-de8a-49cf-9304-9cf4220f5b04 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.864924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.865566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.865881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.866117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.866805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.867871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 792/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.868391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.869081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.869370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.869645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.876643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:25.880537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 805/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.881378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.893524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a6a3-7a2a-4f2a-a6d3-3c5e5d53d99b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.898391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.898868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] MFA Rules not processed for user `2d4e33733bd6487daf40c527d13d33e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:25.898994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.899270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.899548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.900100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:25.900240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.902375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.912636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 806/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.913429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.923454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700d06-f668-4caf-a77a-f4c1f55d5d0b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:25.928012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:25.928598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.928883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.929163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.929873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:25.931441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0fdce-511e-4ff0-85c4-46754690eaac admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:25.942019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 807/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:25.943042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519aae6-9912-455b-b04a-5572803de728 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:25.943334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519aae6-9912-455b-b04a-5572803de728 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:25.943616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519aae6-9912-455b-b04a-5572803de728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:25.971147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 793/1600] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:25.972066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:25.984030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4519aae6-9912-455b-b04a-5572803de728 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:25.985293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4519aae6-9912-455b-b04a-5572803de728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.039731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243cd8-cd0e-420b-b593-f08303efe9d9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.040718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.040951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.041238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.042172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.051227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.052604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.061162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 808/1601] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Jul 26 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.062155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519aae6-9912-455b-b04a-5572803de728 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.063176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 794/1602] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:26.064134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.072739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519aae6-9912-455b-b04a-5572803de728 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.075221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41372f6d-5b7b-4c89-81b3-21ca56dcb92f service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.078117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.078744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.079029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.079306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.080009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.081271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.081613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.082057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.082344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.082622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.083312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.084915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.093515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 809/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:26.094282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.101616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 795/1604] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:26.102491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.109288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb99ad1-29b1-47b1-9c81-2ca2739d6a8b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.114487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.115325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.115634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.116026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] PATH_INFO: `/v3/projects/2e78f887e575440eb9c0d15d69633612/users/6830ff2792294da9951e44ca72d463ac/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.117123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d046-efa6-42e3-ae97-1f455fda44ff admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.122860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.123822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.123822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.124118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] PATH_INFO: `/v3/projects/27a83d1592e34bce9d3d68f356206540/users/a298ec3430b9472e95610154e6d79f9d/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.133278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e78f887e575440eb9c0d15d69633612, user_id=6830ff2792294da9951e44ca72d463ac, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.135989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.144765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a83d1592e34bce9d3d68f356206540, user_id=a298ec3430b9472e95610154e6d79f9d, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.148403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47f09d-45ab-4607-98ce-c60ad9c41631 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.150541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 810/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:26 2022] PUT /identity/v3/projects/2e78f887e575440eb9c0d15d69633612/users/6830ff2792294da9951e44ca72d463ac/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:26.163275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.166100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 796/1606] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:26 2022] PUT /identity/v3/projects/27a83d1592e34bce9d3d68f356206540/users/a298ec3430b9472e95610154e6d79f9d/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:26.169048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428107d-2d02-4bf0-becd-11de958b70b5 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.169857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428107d-2d02-4bf0-becd-11de958b70b5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.170298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428107d-2d02-4bf0-becd-11de958b70b5 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.172239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 797/1607] 10.222.0.47 () {54 vars in 962 bytes} [Tue Jul 26 12:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:26.173251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428107d-2d02-4bf0-becd-11de958b70b5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.242588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:26.244831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b22c2-b73a-4d53-aec0-aba1af8a9d68 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.259792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:26.263865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428107d-2d02-4bf0-becd-11de958b70b5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.269783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.272841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.272841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.272841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.321449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.322099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.322379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.322687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] PATH_INFO: `/v3/projects/19cae232a1c74af98f063a536c996e81/users/317bb9170d4645e490534119e05db73a/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.336352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.338061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.340638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19cae232a1c74af98f063a536c996e81, user_id=317bb9170d4645e490534119e05db73a, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.343691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.347767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 798/1608] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:26.348566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.361028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f823f-daea-4790-846c-e1986c9c1b50 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.362253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 811/1609] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:26 2022] PUT /identity/v3/projects/19cae232a1c74af98f063a536c996e81/users/317bb9170d4645e490534119e05db73a/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:26.363249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.436001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.437348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.437644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.437961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] PATH_INFO: `/v3/projects/f3406960d0cf4732af74dd60a55e90f8/users/05776e7045fc4e44887cc3cf25e35ffd/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.440628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb83b5-5241-41eb-9722-f7199ac15c5f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.446377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.447140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.447497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.447852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] PATH_INFO: `/v3/projects/a3a641241dbf4cbb8d42344528daf50a/users/6370c0b81bb347c8bf3de4d98d80060e/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.460981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3406960d0cf4732af74dd60a55e90f8, user_id=05776e7045fc4e44887cc3cf25e35ffd, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.464654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f6b8-3d3b-41f2-804e-773bb4c6d19b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.464777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a641241dbf4cbb8d42344528daf50a, user_id=6370c0b81bb347c8bf3de4d98d80060e, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.467728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfccb-016d-4c4b-a8e6-708c9a394dde admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.488203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 799/1610] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:26 2022] PUT /identity/v3/projects/f3406960d0cf4732af74dd60a55e90f8/users/05776e7045fc4e44887cc3cf25e35ffd/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:26.492731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 812/1611] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:26 2022] PUT /identity/v3/projects/a3a641241dbf4cbb8d42344528daf50a/users/6370c0b81bb347c8bf3de4d98d80060e/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:26.492856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06997-daf8-4e61-ad0b-3d05513d7807 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.492856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06997-daf8-4e61-ad0b-3d05513d7807 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.492856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06997-daf8-4e61-ad0b-3d05513d7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.493096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aaf8-76df-4a76-b9da-27ce2ba879f5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.493096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aaf8-76df-4a76-b9da-27ce2ba879f5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.493247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aaf8-76df-4a76-b9da-27ce2ba879f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.527831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2490aaf8-76df-4a76-b9da-27ce2ba879f5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.529339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2490aaf8-76df-4a76-b9da-27ce2ba879f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.567643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-28f06997-daf8-4e61-ad0b-3d05513d7807 None None] MFA Rules not processed for user `6830ff2792294da9951e44ca72d463ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.569726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-28f06997-daf8-4e61-ad0b-3d05513d7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.627888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 813/1612] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.629662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f230-ea5d-4f50-a668-4adfd6a74687 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.630213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f230-ea5d-4f50-a668-4adfd6a74687 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.630728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f230-ea5d-4f50-a668-4adfd6a74687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.660373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b041f230-ea5d-4f50-a668-4adfd6a74687 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.662539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 800/1613] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.663110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b041f230-ea5d-4f50-a668-4adfd6a74687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.667583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd8d-c451-492a-a0e6-47401f1df561 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.668487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd8d-c451-492a-a0e6-47401f1df561 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.668773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd8d-c451-492a-a0e6-47401f1df561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.692672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:26.694743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:26.708193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7f25dd8d-c451-492a-a0e6-47401f1df561 None None] MFA Rules not processed for user `317bb9170d4645e490534119e05db73a`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.710279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7f25dd8d-c451-492a-a0e6-47401f1df561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.747795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 814/1614] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.749445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0375-9f57-4670-aea5-8699afa09b0a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.750068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0375-9f57-4670-aea5-8699afa09b0a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.750355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0375-9f57-4670-aea5-8699afa09b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.770166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c9ca0375-9f57-4670-aea5-8699afa09b0a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.772168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c9ca0375-9f57-4670-aea5-8699afa09b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.780740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 815/1615] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.782107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.782399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.782678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.790296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 801/1616] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.791923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb532c2-d1fe-47d4-8e03-50af7eacb5a9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.792667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb532c2-d1fe-47d4-8e03-50af7eacb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.793184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb532c2-d1fe-47d4-8e03-50af7eacb5a9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.795353 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 802/1617] 10.222.0.47 () {54 vars in 912 bytes} [Tue Jul 26 12:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:26.796422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb532c2-d1fe-47d4-8e03-50af7eacb5a9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.810027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:26.811382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:26.834739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 816/1618] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:26.839169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.853119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3db8-d77c-46c5-ad5a-986278ee8476 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.858699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.859348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.859639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.859924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.860658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.863283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.880513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb532c2-d1fe-47d4-8e03-50af7eacb5a9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:26.892000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:26.893007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:26.893387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:26.893767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:26.905338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:26.907121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:26.909626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 817/1619] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:26 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:26.910674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.920328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 803/1620] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:26.921515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:26.931957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c840-c3b7-4838-8ea9-60812ca8956f service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.001439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.002617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.003108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.003625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.010027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057edda-9731-46aa-929d-a8e0c9168127 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.018472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.019199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.019574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.019938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.069418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:27.082751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.084692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26723f-4197-4c46-bc64-d32092f82ac5 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.093574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.095604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.097832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 804/1621] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:27.099309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.099854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.100275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.106655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 818/1622] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:27.107829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.118364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136121-1dfc-4cdb-8245-66f212b9bb3c service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.123580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.124485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.125033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.125394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.127395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:27.128822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:27.138572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.140135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.140643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 805/1623] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:27.141570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.156771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79747e87-13cb-47e4-8b28-2d5309e1c3d3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.161862 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 819/1624] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:27.162778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.168206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:27.168852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.171089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.171554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.173098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.174436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.179587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.225117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a382a5-a1b7-4ab0-aa85-d611774fd966 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.226667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 806/1625] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:27 2022] POST /identity/v3/users => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:27.230018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.230789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.231099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.231456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.231844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.243849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.245399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.253474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49c5c3-f7a3-4370-aba2-a5026d8979db admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.258509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 820/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:27.265707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.266421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.266715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.267204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.267930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.271804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d335a-e69a-4993-bbb8-52ab5381f86f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.301351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 807/1627] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:27.303365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.318295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e628fb-b0aa-4a12-8d3e-8b8968ff9fa8 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.324111 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.325251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.325633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.326028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] PATH_INFO: `/v3/projects/8294a85ab2ae450e9c6391e20d50367b/users/3e9641c9c926461e8b7aa89716fa5d60/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.371034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8294a85ab2ae450e9c6391e20d50367b, user_id=3e9641c9c926461e8b7aa89716fa5d60, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.380839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.402545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 821/1628] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:27 2022] PUT /identity/v3/projects/8294a85ab2ae450e9c6391e20d50367b/users/3e9641c9c926461e8b7aa89716fa5d60/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:51:27.406161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.406794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d25a-c780-47c3-9ceb-2358b3fc7dd9 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.407175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d25a-c780-47c3-9ceb-2358b3fc7dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.407441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d25a-c780-47c3-9ceb-2358b3fc7dd9 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.408932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 808/1629] 10.222.0.47 () {54 vars in 912 bytes} [Tue Jul 26 12:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:27.415590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.415925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.416161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.460831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:27.463189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:27.490685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f2b7-7197-49fc-a7ee-3fb9b113c6c3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.498012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.499168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.499567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.501415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.502577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.505125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.522614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 822/1630] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:27.526709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.542159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff15f-654e-469c-a0b3-d62581e09358 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.554025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.554979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.556037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.556662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] PATH_INFO: `/v3/projects/8294a85ab2ae450e9c6391e20d50367b/users/3e9641c9c926461e8b7aa89716fa5d60/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.559495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8294a85ab2ae450e9c6391e20d50367b, user_id=3e9641c9c926461e8b7aa89716fa5d60, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.564647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7128-2d20-49ae-bf88-36aa212e29ce admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:27.591252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 823/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:27 2022] PUT /identity/v3/projects/8294a85ab2ae450e9c6391e20d50367b/users/3e9641c9c926461e8b7aa89716fa5d60/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:27.601210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.601508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.601795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.629445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 809/1632] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:27.655418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:27.661126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] MFA Rules not processed for user `3e9641c9c926461e8b7aa89716fa5d60`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:27.662881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:27.768528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:27.768749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931109c-b07a-4958-a3e6-d0f434aac991 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:27.810894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 824/1633] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:27.878139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:27.880189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:27.880734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:27.881274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:27.911110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:27.987368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:27.989117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:28.003540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 810/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:51:28.109729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:28.124485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e013209-5d3f-4490-b478-b0d30e3e6449 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:28.130559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:28.131129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:28.131412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:28.131692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:28.172508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:28.177582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:28.269097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 825/1635] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:28.417465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:28.434236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1052-085a-4c19-9a87-f6d9e50257d4 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:28.441774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:28.442371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:28.442658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:28.442940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:28.520695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:28.522359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b69f0-cbc6-428d-9eca-21e20a392b5b service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:28.535400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 811/1636] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:29.015748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:29.188432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be56d-de37-4a09-ad1d-aa8883e7b034 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:29.205076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:29.206460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:29.206748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:29.207028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] PATH_INFO: `/v3/users/317bb9170d4645e490534119e05db73a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:29.208402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317bb9170d4645e490534119e05db73a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:29.209504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: WARNING py.warnings [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:29.209504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: warnings.warn(msg) Jul 26 12:51:29.209504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: Jul 26 12:51:29.210991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:29.352326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317bb9170d4645e490534119e05db73a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:29.354173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317bb9170d4645e490534119e05db73a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:29.356006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317bb9170d4645e490534119e05db73a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:29.391429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317bb9170d4645e490534119e05db73a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:29.407661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317bb9170d4645e490534119e05db73a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:29.433665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 826/1637] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:29 2022] DELETE /identity/v3/users/317bb9170d4645e490534119e05db73a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:29.439400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:29.441180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:29.441780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:29.498480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:29.502094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:29.654022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 812/1638] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:29.680591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:29.682557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:29.818956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d382e-0f0b-42e9-9812-7d4e153a6998 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:29.824285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:29.825037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:29.825329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:29.825726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:29.842089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:29.844559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f533-7837-48e7-adf7-f2d37125432d service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:29.854168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:29.869020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 827/1639] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:51:30.397476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:30.399219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:30.436089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75763c5c-786b-4b24-bf22-9de5d844459f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:30.454402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:30.455616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:30.456010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:30.456409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] PATH_INFO: `/v3/users/5b9251bed8bf45e6bd43af84a1e6e52f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:30.459920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9251bed8bf45e6bd43af84a1e6e52f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:30.462977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:30.596404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:30.619271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9251bed8bf45e6bd43af84a1e6e52f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:30.634495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9251bed8bf45e6bd43af84a1e6e52f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:30.635458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9251bed8bf45e6bd43af84a1e6e52f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:30.660687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9251bed8bf45e6bd43af84a1e6e52f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:30.697468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9251bed8bf45e6bd43af84a1e6e52f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:30.728748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 813/1640] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:30 2022] DELETE /identity/v3/users/5b9251bed8bf45e6bd43af84a1e6e52f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:30.734405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:30.734870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:30.735261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:30.774172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:30.776038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:30.880569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 828/1641] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:30.905476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:30.907386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:31.080890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a68be-b733-43b1-906d-54ab07318dbd admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:31.092409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:31.093713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:31.094758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:31.095254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:31.129090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:31.134313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650074-2d5c-463a-a7d4-81eaa3fe48a1 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:31.155544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 814/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:31.574097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:31.576031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:31.596938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d932-a820-4990-bcae-bdbe4fd8284b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:31.606650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:31.607847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:31.608272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:31.608727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] PATH_INFO: `/v3/users/6830ff2792294da9951e44ca72d463ac` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:31.610303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6830ff2792294da9951e44ca72d463ac)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:31.614073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:31.717449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6830ff2792294da9951e44ca72d463ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:31.718978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6830ff2792294da9951e44ca72d463ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:31.719774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6830ff2792294da9951e44ca72d463ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:31.740304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6830ff2792294da9951e44ca72d463ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:31.760860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6830ff2792294da9951e44ca72d463ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:31.807359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:31.807983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:31.808876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:31.810002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 829/1643] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:31 2022] DELETE /identity/v3/users/6830ff2792294da9951e44ca72d463ac => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:31.855716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:31.857112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:31.922768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:31.927052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:32.021277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 815/1644] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:32.066564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:32.068096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:32.076748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ce53-b6b9-4c8c-9762-7446ce682cb0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:32.101123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:32.102248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.102715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.103846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] PATH_INFO: `/v3/projects/19cae232a1c74af98f063a536c996e81` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.107393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=19cae232a1c74af98f063a536c996e81)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:32.124600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:32.175265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:32.197547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea13989-54f4-4149-a4d5-21e88fd5515e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:32.209731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:32.210576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.211025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.211550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.233243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:32.235118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5b8d-7bcc-40dd-9905-42c9389242fa service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:32.258767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19cae232a1c74af98f063a536c996e81', 'request_id': 'req-9e21414a-e51f-47e7-be32-495dfc5a27ab'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.258944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 816/1645] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:51:32.275978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19cae232a1c74af98f063a536c996e81', 'request_id': 'req-9e21414a-e51f-47e7-be32-495dfc5a27ab'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.302295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19cae232a1c74af98f063a536c996e81', 'request_id': 'req-9e21414a-e51f-47e7-be32-495dfc5a27ab'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.322062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] The token cache is being invalidate because project 19cae232a1c74af98f063a536c996e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:32.323129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.324908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9e21414a-e51f-47e7-be32-495dfc5a27ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.328534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 830/1646] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:31 2022] DELETE /identity/v3/projects/19cae232a1c74af98f063a536c996e81 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:32.333771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.334226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.334582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.347629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:32.383457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:32.384933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:32.519299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 817/1647] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:32.527899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.528192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.528472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.567601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:32.568853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:32.592344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 831/1648] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:32.594992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:32.615611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127560d-810d-4736-9784-75a4dcc435e5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:32.633363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:32.635579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.635881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.637108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.639818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:32.640137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:32.645439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:32.698309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 818/1649] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:32.700316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:32.717313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c2f2-4e98-44ff-90c1-b3b85fb7832f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:32.718017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:32.719774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:32.743518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d749db-90ec-4939-a02f-0dcd231af37e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:32.753624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:32.754359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.754579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.754922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] PATH_INFO: `/v3/projects/c0ae6201eef44f6bacb5614b4b943392` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.756431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ae6201eef44f6bacb5614b4b943392)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:32.758451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: WARNING py.warnings [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:51:32.758451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: warnings.warn(msg) Jul 26 12:51:32.758451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: Jul 26 12:51:32.759654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:32.766355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:32.773011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.776424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.779115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:32.784717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:32.817583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:32.896844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ae6201eef44f6bacb5614b4b943392', 'request_id': 'req-4f25adcd-ac73-4d3c-aa75-9949803e0888'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.916281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ae6201eef44f6bacb5614b4b943392', 'request_id': 'req-4f25adcd-ac73-4d3c-aa75-9949803e0888'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.923960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ae6201eef44f6bacb5614b4b943392', 'request_id': 'req-4f25adcd-ac73-4d3c-aa75-9949803e0888'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.952131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 832/1650] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:32 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:32.957006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:32.973316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] The token cache is being invalidate because project c0ae6201eef44f6bacb5614b4b943392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:32.973726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.976031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4f25adcd-ac73-4d3c-aa75-9949803e0888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:32.982875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 819/1651] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:32 2022] DELETE /identity/v3/projects/c0ae6201eef44f6bacb5614b4b943392 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:32.984641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20243df-7033-4234-b894-96901f981215 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:32.985363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20243df-7033-4234-b894-96901f981215 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:32.985757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20243df-7033-4234-b894-96901f981215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.013792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e20243df-7033-4234-b894-96901f981215 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:33.017532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e20243df-7033-4234-b894-96901f981215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:33.133596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1ad1-4b4c-4aa1-841b-e4438420fd04 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.149115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.149785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.150110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.150396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.151864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.159048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.179011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 820/1652] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:33.187681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.188120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.188617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.230992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 833/1653] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:32 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:33.235043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.239141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:33.255746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:33.257287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:33.271967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038506-1a32-4456-ba8b-42d9250c6ffa admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.275671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 821/1654] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:33.279883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.280729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.283396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.283829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.284238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.285090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.289293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.293171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba971ab5-9390-48e1-8495-150f3d6805d4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.304593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.305236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.305516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.305796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.306527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:33.306836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.308560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.310367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:33.319328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 834/1655] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:33.323464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.331624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 822/1656] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:51:33.336132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.355755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb419be-dfd9-402d-b50e-1948cc575098 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.357275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3738-2f01-4efd-9705-807f59429f10 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.363336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.364165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.364558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.364942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.365719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.367808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.376323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.376971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.377276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.377539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.378286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.379924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.398456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 835/1657] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:33.404790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 823/1658] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:33 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:33.408706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.410193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.433415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40aff-1276-4d8e-aab3-34e819dc14a5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.501985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f103b35-b52f-4a86-ade9-97032953b683 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.513789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.515274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.515274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.515758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.516622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.519394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.528610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:33.567759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 824/1659] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:33 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:33.572432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.572590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.573145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.573538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.573996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] PATH_INFO: `/v3/projects/e533fb243e194af8a3c536d9f1e3fcf5/users/eb2df8bf12c6477d9d01e0554bae61e2/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.599379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395d7bc-f76c-4b33-890b-1edf5b36a7eb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.614199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e533fb243e194af8a3c536d9f1e3fcf5, user_id=eb2df8bf12c6477d9d01e0554bae61e2, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.615424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.616992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.619484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.619967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.620514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.621418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.626189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d41fc5-9282-42ee-b284-c2644e3976d7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.657357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 825/1661] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:33.657777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.658323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.658805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.659717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 836/1661] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:33 2022] PUT /identity/v3/projects/e533fb243e194af8a3c536d9f1e3fcf5/users/eb2df8bf12c6477d9d01e0554bae61e2/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:33.660880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.737866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] MFA Rules not processed for user `eb2df8bf12c6477d9d01e0554bae61e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:33.739187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:33.831517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711e29-93dd-49d3-908c-adad9badddd3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.847555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.848470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.848768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.849057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.850715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.852558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.880968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 837/1662] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:33.885599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.905585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 826/1663] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:33.911286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:33.923751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e7e1-ad81-480b-9a3f-c46ccec767ae admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.937234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.937965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.938259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.939144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] PATH_INFO: `/v3/projects/3ada95b56aa34c55bb25d592be86d50f/users/123ac51bfb6143c8add07e32140aba11/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.939624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b797cb-3003-4ac8-af3e-cf0b64d56a2d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:33.956562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:33.957407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:33.957798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:33.958206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:33.959081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.961518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcadfa-ca44-4e2e-8b96-7f7f97dca133 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:33.982344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ada95b56aa34c55bb25d592be86d50f, user_id=123ac51bfb6143c8add07e32140aba11, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:33.985528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:34.008479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 838/1664] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:33 2022] PUT /identity/v3/projects/3ada95b56aa34c55bb25d592be86d50f/users/123ac51bfb6143c8add07e32140aba11/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:34.020080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:34.028534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:34.041179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 827/1665] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:33 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:34.041179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:34.041179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:34.041179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:34.115375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] MFA Rules not processed for user `123ac51bfb6143c8add07e32140aba11`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:34.118593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:34.139350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:34.185257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a84c8a-4348-43d5-9661-301687241668 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:34.290443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:34.332619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:34.333536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:34.334014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:34.334435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] PATH_INFO: `/v3/projects/2e78f887e575440eb9c0d15d69633612` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:34.336821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e78f887e575440eb9c0d15d69633612)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:34.340665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:34.359864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 828/1666] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:34.362472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:34.386735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8907c72-6c28-42a6-a1da-ea8d081096c7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:34.404828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:34.405849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:34.406377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:34.406878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:34.407763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:34.412149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:34.448926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 829/1667] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:34 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:34.450797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:34.484084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676540-7758-4598-88ac-d4311fecf59c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:34.547899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e78f887e575440eb9c0d15d69633612', 'request_id': 'req-cfd6b222-b099-40af-9435-28aa6b4730b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:34.594263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e78f887e575440eb9c0d15d69633612', 'request_id': 'req-cfd6b222-b099-40af-9435-28aa6b4730b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:34.619883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e78f887e575440eb9c0d15d69633612', 'request_id': 'req-cfd6b222-b099-40af-9435-28aa6b4730b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:34.658740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] The token cache is being invalidate because project 2e78f887e575440eb9c0d15d69633612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:34.660597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:34.662639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:34.668342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 839/1668] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:34 2022] DELETE /identity/v3/projects/2e78f887e575440eb9c0d15d69633612 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:34.668342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:34.674917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:34.767395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:34.772840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:34.773268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:34.773657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:34.774490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:34.776633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:34.881087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 830/1669] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:34 2022] POST /identity/v3/projects => generated 379 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:34.882025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:34.891978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:34.893856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6b222-b099-40af-9435-28aa6b4730b7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.119631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.131324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.131725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.132020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.136091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.165928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.208688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 840/1670] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:35.214516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:35.220860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:35.266156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c5e7-1706-4d45-b551-2af1b2f32f60 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.277718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.278868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.279154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.279549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] PATH_INFO: `/v3/users/3e9641c9c926461e8b7aa89716fa5d60` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.280944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9641c9c926461e8b7aa89716fa5d60)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.283189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.295374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d62c1-0f57-48ce-8d76-4daffef91475 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.320284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.321291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.321572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.321785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.335555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.338173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:35.345690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.394184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:35.424821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 841/1671] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:35 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:35.425592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:35.448941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9641c9c926461e8b7aa89716fa5d60'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.457331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4ee5-8944-4d7d-a771-7606f7ea99a4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.468757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9641c9c926461e8b7aa89716fa5d60'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.469590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9641c9c926461e8b7aa89716fa5d60'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.479487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.482534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.482829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.483116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] PATH_INFO: `/v3/projects/ad573d778d06424cbbd4323064e1b49c/users/398858821c58445c84d10d810b3fdaf7/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.491231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9641c9c926461e8b7aa89716fa5d60'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.518207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad573d778d06424cbbd4323064e1b49c, user_id=398858821c58445c84d10d810b3fdaf7, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.523337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.526106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9641c9c926461e8b7aa89716fa5d60'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.551388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 831/1672] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:34 2022] DELETE /identity/v3/users/3e9641c9c926461e8b7aa89716fa5d60 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:35.553927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:35.558608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:35.577491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 842/1673] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:35 2022] PUT /identity/v3/projects/ad573d778d06424cbbd4323064e1b49c/users/398858821c58445c84d10d810b3fdaf7/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:35.577491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:35.578406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:35.717184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc5def-0de4-4c17-913d-a0e1c64fbb5e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.752661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3e8d-b1c1-483f-a7b0-0b582a9f22ea admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.767641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.768317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.768593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.768865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] PATH_INFO: `/v3/users/2d4e33733bd6487daf40c527d13d33e9` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.772612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4e33733bd6487daf40c527d13d33e9)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.774615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.882896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.887458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.888069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.888488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.891122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:35.893176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:35.935172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4e33733bd6487daf40c527d13d33e9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.936883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 843/1674] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:35.937884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:35.941929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:35.953022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4e33733bd6487daf40c527d13d33e9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.953984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4e33733bd6487daf40c527d13d33e9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.973061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4e33733bd6487daf40c527d13d33e9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:35.978480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acb64-8075-460d-815b-3dfad662f6c7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:35.991664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:35.992315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:35.992600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:35.992876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:35.997338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:36.001309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2b27c-3957-4b3d-bc8a-b6a438065ce7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:36.005793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4e33733bd6487daf40c527d13d33e9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:36.030063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 832/1675] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:35 2022] DELETE /identity/v3/users/2d4e33733bd6487daf40c527d13d33e9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:36.031061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.033087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 844/1676] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:36.033496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.036186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.036488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.036754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.071831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:36.100023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:36.106710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.269237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd262-ffc2-4c37-b42d-0771685f1d98 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.280690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:36.281423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.281709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.282189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] PATH_INFO: `/v3/projects/9530a1dbe235418292ad1115b94bdd77/users/98e91d9c4fdf410a96be1ce23c4145ee/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.324331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530a1dbe235418292ad1115b94bdd77, user_id=98e91d9c4fdf410a96be1ce23c4145ee, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:36.327323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:36.341843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 845/1677] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:36.346873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.353380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.356307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 833/1678] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:36 2022] PUT /identity/v3/projects/9530a1dbe235418292ad1115b94bdd77/users/98e91d9c4fdf410a96be1ce23c4145ee/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:36.360329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.397154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6ea3-f272-4375-a309-2e04d736e5a9 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.409436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:36.519599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328a9d-1447-467c-8b0f-326429094efc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.532614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:36.533320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.533755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.534061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] PATH_INFO: `/v3/projects/ad573d778d06424cbbd4323064e1b49c/users/398858821c58445c84d10d810b3fdaf7/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.536573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad573d778d06424cbbd4323064e1b49c, user_id=398858821c58445c84d10d810b3fdaf7, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:36.536699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:36.537287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.537576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.537874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.538586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:36.539726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff0b83-06db-4eef-a9ef-43308087502e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:36.540173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:36.564139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 846/1679] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:36 2022] PUT /identity/v3/projects/ad573d778d06424cbbd4323064e1b49c/users/398858821c58445c84d10d810b3fdaf7/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:36.575265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.580924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 834/1680] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:36.582210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.586095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.586734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.607497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c6ce-cf95-4350-aa4d-7e88f337e1c3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.657460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] MFA Rules not processed for user `398858821c58445c84d10d810b3fdaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:36.659285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.777402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:36.778113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.778395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.778673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] PATH_INFO: `/v3/projects/9530a1dbe235418292ad1115b94bdd77/users/98e91d9c4fdf410a96be1ce23c4145ee/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:36.783105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530a1dbe235418292ad1115b94bdd77, user_id=98e91d9c4fdf410a96be1ce23c4145ee, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:36.785198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:36.809326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 847/1681] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:36.810950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.814302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.815553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 835/1682] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:36 2022] PUT /identity/v3/projects/9530a1dbe235418292ad1115b94bdd77/users/98e91d9c4fdf410a96be1ce23c4145ee/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:36.816520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:36.826908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:36.902885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:36.979460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816afbe1-4503-4012-aad1-681004ddcb78 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.981615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec295c1e-ceea-4ced-8492-77f32c7a91f8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:36.997921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:36.998601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:36.998886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:36.999163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] PATH_INFO: `/v3/projects/8294a85ab2ae450e9c6391e20d50367b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.001380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8294a85ab2ae450e9c6391e20d50367b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.004041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.092930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:37.109400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.110268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.110701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.111094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.121937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8294a85ab2ae450e9c6391e20d50367b', 'request_id': 'req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:37.138379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8294a85ab2ae450e9c6391e20d50367b', 'request_id': 'req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:37.140714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.142349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.152238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8294a85ab2ae450e9c6391e20d50367b', 'request_id': 'req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:37.160069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 848/1683] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:37.161154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.168893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.181725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] The token cache is being invalidate because project 8294a85ab2ae450e9c6391e20d50367b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:37.182053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:37.185062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdce1de-cf0f-4b66-bfdf-0ffd5457a133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:37.197913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 836/1684] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:36 2022] DELETE /identity/v3/projects/8294a85ab2ae450e9c6391e20d50367b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:37.200191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424116-8087-44dc-92a6-f3677b2d895d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.200632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424116-8087-44dc-92a6-f3677b2d895d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.201106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424116-8087-44dc-92a6-f3677b2d895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.259894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-51424116-8087-44dc-92a6-f3677b2d895d None None] MFA Rules not processed for user `98e91d9c4fdf410a96be1ce23c4145ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:37.263280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-51424116-8087-44dc-92a6-f3677b2d895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.302622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f703-ff34-4e96-a4e7-55be8cffd28c service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:37.383954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 837/1685] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:37.388966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.388966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.388966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.426952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.427610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.427904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.428186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.431188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.435320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:37.436559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.526746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:37.572813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 838/1686] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:37.574347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.577268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.578783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15970942-624e-4963-b77f-846f55fbe720 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.579906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.604607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d3cb0-741a-4b69-afa0-2f1d55e3c294 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:37.605501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 849/1687] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:37.607016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.607291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.607573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.616938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.617589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.617896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.618176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.636985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.641006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.650575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:37.652846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.684239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 839/1688] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:37.693628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 850/1689] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:37.703153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.722158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea4f10-77fe-4487-bbed-23eeb7968515 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:37.737238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.740276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.741649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.742363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.743553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:37.744018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.745826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.799877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 840/1690] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:37.804664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.822438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da61f0-e29f-40ba-9c93-9300a1c8bb80 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:37.826365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.828265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.833037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.833690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.834003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.836219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.838266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.844163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326a66-75ea-4780-9cf7-762cbf9752a8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:37.846606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:37.849969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:37.850881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:37.851312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:37.851736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:37.854025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:37.923140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 851/1691] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:37 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:37.925671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:37.974012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:37.978452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.001263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:38.004331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 841/1692] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:38.005408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:38.035848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad86-171e-4fc7-85d6-0f6c6eb71cec service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:38.105597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d3e26-647a-4a3b-bccc-df8147d61f0a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:38.117187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:38.118608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.121098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.121558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.128183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:38.179840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:38.180488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.181450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.181738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.182456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:38.187235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.237436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 842/1693] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:38 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:38.241506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:38.266465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a3e0-cf66-4f14-b19e-de4cae8839c5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:38.278732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:38.279664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.279908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.280035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.280833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:38.282371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.311478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 843/1694] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:51:38.314969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:38.334745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:38.339357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc398c-703e-4e2a-96fb-fbb2bfbe15c7 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:38.340709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.360049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:38.360780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.360973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.361483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.362248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:38.363855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e11f82-9e3f-4749-987a-fe54136943af admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.388465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 852/1695] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:38.400787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 844/1696] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:51:38.402874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:38.423337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e2c3-856d-4583-90f3-f94331913634 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:38.440569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:38.441279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.444794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.445132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] PATH_INFO: `/v3/projects/f19f484bead64aa28023c8eab9c0bb66/users/08da986f545345b6831e336608211ef3/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.491555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19f484bead64aa28023c8eab9c0bb66, user_id=08da986f545345b6831e336608211ef3, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:38.508079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:38.567395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 853/1697] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:38 2022] PUT /identity/v3/projects/f19f484bead64aa28023c8eab9c0bb66/users/08da986f545345b6831e336608211ef3/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:38.570789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:38.571085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:38.571369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:38.646951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] MFA Rules not processed for user `08da986f545345b6831e336608211ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:38.648573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:38.705001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:38.861029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:38.864536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:38.902908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 845/1698] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:38.906254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.027405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a59dd-ae15-4816-8032-aa352f1562ca admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.032016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.032806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.033706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.034162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] PATH_INFO: `/v3/projects/0a3348900ff04f429fb4f531c8ca20b2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.035487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3348900ff04f429fb4f531c8ca20b2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.040229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.044993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aea05-e129-4e50-b327-37ffc15bc1c3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.050025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.050676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.050950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.051275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.052411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.054663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.093979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 846/1699] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:38 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:39.099483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.142954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3348900ff04f429fb4f531c8ca20b2', 'request_id': 'req-7909409c-d6c5-4dda-8ef3-35cf5e36981c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:39.152354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3348900ff04f429fb4f531c8ca20b2', 'request_id': 'req-7909409c-d6c5-4dda-8ef3-35cf5e36981c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:39.155343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:39.166591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3348900ff04f429fb4f531c8ca20b2', 'request_id': 'req-7909409c-d6c5-4dda-8ef3-35cf5e36981c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:39.192237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2c01-afe7-413a-98c5-54371f73874b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.199258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] The token cache is being invalidate because project 0a3348900ff04f429fb4f531c8ca20b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:39.199605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:39.202905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7909409c-d6c5-4dda-8ef3-35cf5e36981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:39.207433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 854/1700] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:38 2022] DELETE /identity/v3/projects/0a3348900ff04f429fb4f531c8ca20b2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:39.214748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69d0d-d697-4b89-941e-b2be890f3972 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.215060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69d0d-d697-4b89-941e-b2be890f3972 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.215305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69d0d-d697-4b89-941e-b2be890f3972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.239601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8df69d0d-d697-4b89-941e-b2be890f3972 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:39.241440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8df69d0d-d697-4b89-941e-b2be890f3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:39.287440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:39.320369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.321065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.321287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.321564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.322262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.330734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.359502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 855/1701] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:39.368097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.369537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.369867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.386533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 847/1702] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:39 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:39.387600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.395541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:39.421799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a277bf-4956-47d3-ab3f-b2a22419c861 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.426576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:39.427839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:39.433061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.434478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.435103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.435592 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.436519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.438580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.451125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 856/1703] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:39.455436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.473109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 848/1704] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:39.478637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.482775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbedce-edf5-4590-941a-5e5faedac9c3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.501533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519320d9-fe8c-4acc-913c-7c647c1e510b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.502447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.503451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.503879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.504440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.505343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:39.505855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.507648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.510916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.512063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.512421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.512895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] PATH_INFO: `/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec/users/6b2faae440fc4fff92a79819c040bbae/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.547163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 857/1705] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:39.551786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.558466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3367e9bcaa34408caf3e8e745da2a5ec, user_id=6b2faae440fc4fff92a79819c040bbae, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.561755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.572983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4bdeb-ddf2-4e6a-b4bd-552e7c70cd7e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.593434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.595385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.595385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.595511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.596130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.598830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:39.613123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 849/1706] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:39 2022] PUT /identity/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec/users/6b2faae440fc4fff92a79819c040bbae/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:39.616984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.681299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 858/1707] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:39 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:39.683602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:39.816202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075a62-d9a5-4c33-8517-1c168067b573 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.936534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed508-89cd-434e-a1b4-cb793b876d2a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:39.950424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:39.951238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:39.952012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:39.952323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:39.953077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:39.957456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.005660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 859/1708] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:39 2022] POST /identity/v3/users => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:51:40.009877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.035287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.035497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e7147-9601-4fbd-b53d-01d4da192586 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:40.036552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.036913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.037266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.038513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:40.041419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.053517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.054190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.054482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.058231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.059020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:40.061112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.077133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 850/1709] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:40.078746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.092950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 860/1710] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:40.095006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.119258 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a07e-7bce-4a48-83ac-0a2508b3caf1 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:40.123886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb6a7e-0c28-4e49-971f-14ddd9dfd751 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:40.136474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.137465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.137916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.138336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.139190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:40.141098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.147477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.149198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.155170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.155627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] PATH_INFO: `/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec/users/6b2faae440fc4fff92a79819c040bbae/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.160470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3367e9bcaa34408caf3e8e745da2a5ec, user_id=6b2faae440fc4fff92a79819c040bbae, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:40.168117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b74d6-be63-4765-876c-7b41570f6b9b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.171165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 861/1711] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:40.175360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.205936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b93680-1329-44d0-a795-336b9c138a6d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:40.216329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:40.220414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 851/1712] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:40 2022] PUT /identity/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec/users/6b2faae440fc4fff92a79819c040bbae/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:40.235423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac51d7-f8fa-4ed1-97f9-0a2e2dcea811 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.235631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac51d7-f8fa-4ed1-97f9-0a2e2dcea811 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.236492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac51d7-f8fa-4ed1-97f9-0a2e2dcea811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.343912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3aac51d7-f8fa-4ed1-97f9-0a2e2dcea811 None None] MFA Rules not processed for user `6b2faae440fc4fff92a79819c040bbae`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:40.349069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3aac51d7-f8fa-4ed1-97f9-0a2e2dcea811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:40.356554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.359778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.360117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.362633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] PATH_INFO: `/v3/projects/4b693f8b02e744f8b67cff7c8de8d923/users/b24a00874f8a4ecea75c5de20ab6b5b7/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.421035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b693f8b02e744f8b67cff7c8de8d923, user_id=b24a00874f8a4ecea75c5de20ab6b5b7, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:40.433779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666d44-af1c-411a-9a45-37b2a224b1fe admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:40.457841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:40.469894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 862/1713] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:40 2022] PUT /identity/v3/projects/4b693f8b02e744f8b67cff7c8de8d923/users/b24a00874f8a4ecea75c5de20ab6b5b7/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:40.471385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.471694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.473534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.542934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] MFA Rules not processed for user `8245326bacd0477f81fdfdbd86438fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:40.544448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:40.647040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 852/1714] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:40.656324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.656614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.661397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.741827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 863/1715] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:40.741827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.741827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:40.748899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:40.755991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:40.863551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141ccd-39ac-40c4-becb-356fe5273643 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:40.879844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:40.881307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:40.882607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:40.884018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:40.989712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 853/1716] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:40.989712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:40.992302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:41.033664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:41.079772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:41.081341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:41.101083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e913-743b-496a-9527-175e29dd5d43 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:41.108456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:41.108882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 864/1717] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:41.109140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:41.109429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:41.109710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:41.111017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:41.119690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:41.121038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:41.121741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:41.134295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 854/1718] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:41.202315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:41.204461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:41.228237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9a0b-997e-4bb5-a541-9a9027b531c0 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:41.248687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88ee3-61fd-45d4-a0e0-f3b7b0c99d22 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:41.249029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:41.249987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:41.250326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:41.250744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:41.253627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:41.255794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:41.256895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:41.257390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:41.257950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:41.273259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:41.275271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d6d4-5b69-4d1a-81f4-24a485be602b service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:41.308183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 865/1719] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:41.338989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:41.379086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:41.381146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:41.409480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 855/1720] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:51:44.051964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbb8a8-882f-476a-8777-f2377201da55 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.052947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbb8a8-882f-476a-8777-f2377201da55 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.053469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbb8a8-882f-476a-8777-f2377201da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.114794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-95cbb8a8-882f-476a-8777-f2377201da55 None None] MFA Rules not processed for user `b24a00874f8a4ecea75c5de20ab6b5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:44.116437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-95cbb8a8-882f-476a-8777-f2377201da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:44.253227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 866/1721] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:44.259908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:44.278982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140376a2-a0ec-473c-816c-1a76f0d25a62 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:44.280284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee292b6-90d8-4b53-aaf2-48a3c7fd4e1a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.281725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee292b6-90d8-4b53-aaf2-48a3c7fd4e1a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.286342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee292b6-90d8-4b53-aaf2-48a3c7fd4e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.306082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:44.307713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.308014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.308298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.310063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:44.324529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:44.418090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 856/1722] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:44 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:44.422192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:44.436471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-bee292b6-90d8-4b53-aaf2-48a3c7fd4e1a None None] MFA Rules not processed for user `a298ec3430b9472e95610154e6d79f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:44.440716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bee292b6-90d8-4b53-aaf2-48a3c7fd4e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:44.631698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ebd3-91d9-43ed-954c-dcb33001e95c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:44.643427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:44.645785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.647004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.647293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.649142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:44.653129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:44.656451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:44.685611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 867/1723] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:44.707655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.707655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.707655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.738312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 857/1724] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:44 2022] POST /identity/v3/users => generated 309 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:44.741259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:44.761898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] MFA Rules not processed for user `a298ec3430b9472e95610154e6d79f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:44.764532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:44.775621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c27dd-7ca2-4609-939d-90ee587fe71b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:44.781602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 868/1725] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:44.794536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:44.795267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:44.796726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:44.799570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.799859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.800143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.800882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:44.812044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:44.847199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 858/1726] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:44.850732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:44.882941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895427-f835-4a17-87a9-5e788ce68b47 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:44.913505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:44.914234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:44.914916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:44.914916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] PATH_INFO: `/v3/projects/c00dd4533d974edaa684db205c206887/users/e826cddf762646a48a3019afe970ea27/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:44.954386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00dd4533d974edaa684db205c206887, user_id=e826cddf762646a48a3019afe970ea27, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:44.957082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:44.988026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 859/1727] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:44 2022] PUT /identity/v3/projects/c00dd4533d974edaa684db205c206887/users/e826cddf762646a48a3019afe970ea27/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:44.989408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:45.069564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93f467-34d7-4de6-9145-7a084103cab6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:45.157005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a39a-9540-4b6e-9dd5-2209d267fe12 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:45.172159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:45.172671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:45.174917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:45.175224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:45.175954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:45.177567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:45.211170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 860/1728] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:51:45.212366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:45.228272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453ead-6dd8-4841-be67-da13997af0c3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:45.236576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:45.238627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:45.238967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:45.239392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:45.239646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:45.239952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:45.240246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:45.241749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] PATH_INFO: `/v3/projects/c00dd4533d974edaa684db205c206887/users/e826cddf762646a48a3019afe970ea27/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:45.249562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00dd4533d974edaa684db205c206887, user_id=e826cddf762646a48a3019afe970ea27, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:45.254076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8286a-b13b-4c12-ae8c-9c0d0bd19d05 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:45.262837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:45.284153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 861/1729] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:45 2022] PUT /identity/v3/projects/c00dd4533d974edaa684db205c206887/users/e826cddf762646a48a3019afe970ea27/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:45.369071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:45.372184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0724853-8484-4cb6-87b4-ae52e6a63a3a service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:45.392729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 869/1730] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:46.260182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7bd7-15ee-4d6d-ba36-f9285f7f4d8f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.263253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7bd7-15ee-4d6d-ba36-f9285f7f4d8f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.264950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7bd7-15ee-4d6d-ba36-f9285f7f4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:46.418104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-33dc7bd7-15ee-4d6d-ba36-f9285f7f4d8f None None] MFA Rules not processed for user `8245326bacd0477f81fdfdbd86438fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:46.425338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-33dc7bd7-15ee-4d6d-ba36-f9285f7f4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:46.546353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511441-6c3b-4984-9568-24bb0aff9634 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.546870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511441-6c3b-4984-9568-24bb0aff9634 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.546870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511441-6c3b-4984-9568-24bb0aff9634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:46.627855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-97511441-6c3b-4984-9568-24bb0aff9634 None None] MFA Rules not processed for user `6370c0b81bb347c8bf3de4d98d80060e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:46.630285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 862/1731] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:46.631218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-97511441-6c3b-4984-9568-24bb0aff9634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:46.691391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65db6-2d64-439b-b942-22fe59ddab5a None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.691391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65db6-2d64-439b-b942-22fe59ddab5a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.692248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65db6-2d64-439b-b942-22fe59ddab5a None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:46.696018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 863/1732] 10.222.0.47 () {54 vars in 912 bytes} [Tue Jul 26 12:51:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:51:46.704123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6211-7a49-4cda-9e0b-5a730196420f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.704728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:46.705485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6211-7a49-4cda-9e0b-5a730196420f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.705963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6211-7a49-4cda-9e0b-5a730196420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:46.822397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-194f6211-7a49-4cda-9e0b-5a730196420f None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:46.824707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-194f6211-7a49-4cda-9e0b-5a730196420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:46.921209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 870/1733] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:46.922827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e511984-1d7e-4f5a-937d-1e160235522b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.923133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e511984-1d7e-4f5a-937d-1e160235522b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.943359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e511984-1d7e-4f5a-937d-1e160235522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:46.968995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 864/1734] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 26 12:51:46.975608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:46.976062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:46.976352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:47.036660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] MFA Rules not processed for user `6370c0b81bb347c8bf3de4d98d80060e`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:47.038003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:47.053300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3e511984-1d7e-4f5a-937d-1e160235522b None None] MFA Rules not processed for user `05776e7045fc4e44887cc3cf25e35ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:47.055099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3e511984-1d7e-4f5a-937d-1e160235522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:47.067379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 865/1735] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:47.068409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:47.095811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c57ac-7c85-49f9-ab16-c7fa0e1adfe7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:47.105493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:47.106630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:47.106630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:47.106917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:47.128556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:47.131501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:47.157590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 866/1736] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:47.218378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:47.359652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 871/1737] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:47.409024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08fefa-0c56-4730-83a1-10c58ff0a75e service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:47.434320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:47.434320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:47.434660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:47.434890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] PATH_INFO: `/v3/users/08da986f545345b6831e336608211ef3` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:47.446014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08da986f545345b6831e336608211ef3)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:47.449528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:47.483624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:47.609515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08da986f545345b6831e336608211ef3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:47.646395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08da986f545345b6831e336608211ef3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:47.647620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08da986f545345b6831e336608211ef3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:47.681413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08da986f545345b6831e336608211ef3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:47.712263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08da986f545345b6831e336608211ef3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:47.728272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 867/1738] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:47 2022] DELETE /identity/v3/users/08da986f545345b6831e336608211ef3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:51:47.733651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:47.734693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:47.735140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:47.768315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:47.769971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:47.876244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 872/1739] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:47.889057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:47.891598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.069461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8633da-1d75-4d86-a0fa-4e01ed1e6196 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:48.078307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:48.078955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.082068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.082373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.106482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:48.110116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa42889-23f8-4031-b890-38acf4266310 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:48.149938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 868/1740] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:48.182942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:48.185732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.240725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437260a-c226-4950-9f44-26c11628d82f None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.241301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437260a-c226-4950-9f44-26c11628d82f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.241716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437260a-c226-4950-9f44-26c11628d82f None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.244005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 869/1741] 10.222.0.47 () {54 vars in 912 bytes} [Tue Jul 26 12:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 12:51:48.256402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e34670-8e54-437d-bac5-3620088fcd6d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.256875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e34670-8e54-437d-bac5-3620088fcd6d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.257303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e34670-8e54-437d-bac5-3620088fcd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.339214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a1e34670-8e54-437d-bac5-3620088fcd6d None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:48.340477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a1e34670-8e54-437d-bac5-3620088fcd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.376819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 870/1742] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:48.380386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb4d3-6803-4a3c-bdbe-44a037c74601 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.381136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb4d3-6803-4a3c-bdbe-44a037c74601 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.381565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb4d3-6803-4a3c-bdbe-44a037c74601 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.384713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:48.398168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 871/1743] 10.222.0.47 () {54 vars in 961 bytes} [Tue Jul 26 12:51:48 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:48.403577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.404062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.405931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.487753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8565b-763c-429b-b124-b8cf1c11aa3a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:48.492520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] MFA Rules not processed for user `e826cddf762646a48a3019afe970ea27`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:48.493831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.509997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:48.511891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.512008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.512249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.516417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.754998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 872/1744] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:48.756471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:48.763815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:48.775700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:48.784519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac675-66ad-4662-a276-270c3793033f service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:48.796584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7af5-e369-4304-bf07-f5f73fd25fd6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:48.801544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:48.802679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.803211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.803820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.813140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:48.815520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:48.830109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 873/1745] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:48.832144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:48.832898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:48.833346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:48.847243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 873/1746] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:48.886887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:48.890189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.077282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 874/1747] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Jul 26 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:49.085644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.094523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:49.107423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc8c3-1326-4877-8f14-9256c1ce4079 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:49.117451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.119040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.133653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:49.134074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:49.135790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:49.138120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:49.141605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.162093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:49.164496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:49.168615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092076c-b5a8-480a-b24a-6cfcaa38704d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:49.184569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:49.185264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:49.185554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:49.185922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] PATH_INFO: `/v3/projects/f19f484bead64aa28023c8eab9c0bb66` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:49.191513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 874/1748] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:49.192450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.198042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.200280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19f484bead64aa28023c8eab9c0bb66)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:49.202286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:49.233604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fc292-5699-4115-98ba-fd1709fec8e3 service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:49.253761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:49.254448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:49.254735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:49.256867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] PATH_INFO: `/v3/users/123ac51bfb6143c8add07e32140aba11` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:49.260102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=123ac51bfb6143c8add07e32140aba11)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:49.267534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:49.326436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19f484bead64aa28023c8eab9c0bb66', 'request_id': 'req-97978add-4e82-4730-8701-d630fce9b1ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.337064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19f484bead64aa28023c8eab9c0bb66', 'request_id': 'req-97978add-4e82-4730-8701-d630fce9b1ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.354547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19f484bead64aa28023c8eab9c0bb66', 'request_id': 'req-97978add-4e82-4730-8701-d630fce9b1ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.372057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:49.379076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] The token cache is being invalidate because project f19f484bead64aa28023c8eab9c0bb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:49.379289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.381921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.384968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 875/1749] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:49 2022] DELETE /identity/v3/projects/f19f484bead64aa28023c8eab9c0bb66 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:49.389558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.392332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.398954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123ac51bfb6143c8add07e32140aba11'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.416207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123ac51bfb6143c8add07e32140aba11'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.417871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123ac51bfb6143c8add07e32140aba11'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.455160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123ac51bfb6143c8add07e32140aba11'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.491265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d94687ab-44ee-43b0-a30b-764097de54ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123ac51bfb6143c8add07e32140aba11'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.508280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 875/1750] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:49 2022] DELETE /identity/v3/users/123ac51bfb6143c8add07e32140aba11 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:49.514570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:49.514906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:49.515217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:49.552720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978add-4e82-4730-8701-d630fce9b1ef admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:49.580624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:49.581977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.715838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:49.717252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:49.717541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:49.719378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] PATH_INFO: `/v3/users/6b2faae440fc4fff92a79819c040bbae` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:49.722545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2faae440fc4fff92a79819c040bbae)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:49.727087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:49.732033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 876/1751] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:49.761631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.764065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.854954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2faae440fc4fff92a79819c040bbae'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.856429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2faae440fc4fff92a79819c040bbae'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.857188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2faae440fc4fff92a79819c040bbae'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.891207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2faae440fc4fff92a79819c040bbae'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.910691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2faae440fc4fff92a79819c040bbae'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:49.940167 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1a899-53a9-483f-a288-4fe3937b7ef6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:49.944296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 876/1752] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:49 2022] DELETE /identity/v3/users/6b2faae440fc4fff92a79819c040bbae => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:49.945403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:49.948475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:49.983224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:50.022450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:50.102400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:50.104350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:50.108041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:50.109055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:50.112795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:50.157885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8bc3-462a-4f5c-880d-94da318c6750 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:50.178067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:50.180947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:50.180947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:50.181286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:50.187601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:50.274533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:50.276052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:50.305305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 877/1753] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:50.348117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:50.350294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11b0a-efc4-40c2-892f-946d57133687 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:50.388690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 877/1754] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:51.654750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:51.656329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:51.701007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfcded-05d4-4a5e-845a-70c9d4064d9b service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:51.734077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:51.734688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:51.738189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:51.739100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] PATH_INFO: `/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:51.740042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3367e9bcaa34408caf3e8e745da2a5ec)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:51.753639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:51.822390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f0c-ee5e-49b6-9f65-c3ce8253f432 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:51.824724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f0c-ee5e-49b6-9f65-c3ce8253f432 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:51.825195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f0c-ee5e-49b6-9f65-c3ce8253f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:51.849772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-485c6f0c-ee5e-49b6-9f65-c3ce8253f432 None None] MFA Rules not processed for user `a298ec3430b9472e95610154e6d79f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:51.857076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-485c6f0c-ee5e-49b6-9f65-c3ce8253f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:51.955482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3367e9bcaa34408caf3e8e745da2a5ec', 'request_id': 'req-51005ab6-d0ff-475c-8326-2e63171b1ff2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:51.972129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3367e9bcaa34408caf3e8e745da2a5ec', 'request_id': 'req-51005ab6-d0ff-475c-8326-2e63171b1ff2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:51.987513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3367e9bcaa34408caf3e8e745da2a5ec', 'request_id': 'req-51005ab6-d0ff-475c-8326-2e63171b1ff2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:51.994203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 878/1755] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:52.062641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] The token cache is being invalidate because project 3367e9bcaa34408caf3e8e745da2a5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:52.067132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:52.073617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-51005ab6-d0ff-475c-8326-2e63171b1ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:52.075734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 878/1756] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:51 2022] DELETE /identity/v3/projects/3367e9bcaa34408caf3e8e745da2a5ec => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:52.080982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37657-7bf3-4c3d-8563-6a0c7a02eb21 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.081438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37657-7bf3-4c3d-8563-6a0c7a02eb21 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.081734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37657-7bf3-4c3d-8563-6a0c7a02eb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.132379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c5c37657-7bf3-4c3d-8563-6a0c7a02eb21 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:52.139467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c5c37657-7bf3-4c3d-8563-6a0c7a02eb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:52.231603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b9d0-a0a8-4fd4-bdcc-a06b66c2ea48 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.232128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b9d0-a0a8-4fd4-bdcc-a06b66c2ea48 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.232587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b9d0-a0a8-4fd4-bdcc-a06b66c2ea48 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.234256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 879/1757] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:51:52.300230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.300871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.301355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.355701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 879/1758] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:52.363201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.363571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.363953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.380019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:52.385797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:52.433182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:52.436510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:52.466769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 880/1759] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:52.472678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:52.485354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:52.496089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4ee4-963f-4784-82f1-960d19dd9a7c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:52.509364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:52.510674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.511115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.511492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.512304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:51:52.515271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:52.517295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:52.537620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:52.552962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 881/1760] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:51:52.554147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:52.575069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ef6b-6f2c-4369-9332-01403931ae53 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:52.581369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 880/1761] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:52.586545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:52.587995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.589138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.589888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.590904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:52.594014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:52.633170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 882/1762] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:52 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:52.634268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:52.649566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:52.653221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:52.654747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7404-0458-4ba2-bef6-b08c9f47d99b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:52.900533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:52.905105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.908505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.908868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:52.909609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:52.919515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd468acc-ca5a-428d-bff6-64c772c9a8a3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:52.957866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7d01-f489-4556-a93c-efa34cded7f7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:52.985293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:52.988568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:52.989003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:52.989316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.002100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 881/1763] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:52 2022] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:53.004702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9939e4-c973-477c-b0ca-a2e8c9103583 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:53.005234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9939e4-c973-477c-b0ca-a2e8c9103583 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:53.006376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9939e4-c973-477c-b0ca-a2e8c9103583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.014168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:53.019378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:53.068033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 883/1764] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:53.068936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:53.096285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba3b-98ef-49bb-b801-605ec7dfb010 service placement] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:53.134741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:53.138082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:53.139519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:53.139873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.142964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:53.150389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:53.202213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 884/1765] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:53.206516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:53.220389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4b9939e4-c973-477c-b0ca-a2e8c9103583 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:53.225706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4b9939e4-c973-477c-b0ca-a2e8c9103583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:53.244793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f6171-408f-4b33-874e-f6d6fc75d257 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:53.258124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:53.258772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:53.259089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:53.262273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.263157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:53.269278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:53.301487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 885/1766] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:53.306086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:53.337853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae683-19f0-4d6c-9c87-9e72acb1ed7c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:53.350658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:53.372500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:53.372851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:53.373143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] PATH_INFO: `/v3/projects/896c7bd61b7a4923b55ea163f63185a5/users/89b75a7a969244b2a3acfb3efa957af2/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.419351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896c7bd61b7a4923b55ea163f63185a5, user_id=89b75a7a969244b2a3acfb3efa957af2, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:53.429112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:53.442844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 882/1767] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:53.464802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 886/1768] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:53 2022] PUT /identity/v3/projects/896c7bd61b7a4923b55ea163f63185a5/users/89b75a7a969244b2a3acfb3efa957af2/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:53.480763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:53.488332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:53.489529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:53.584770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] MFA Rules not processed for user `89b75a7a969244b2a3acfb3efa957af2`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:53.586796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:53.741561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:53.744096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:53.747444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:53.842270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 883/1769] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:53.844930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.055599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:54.095005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623938-dcf4-4d80-a4d0-cf2a7e202db7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.127266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.128096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.128390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.128766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.129896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.142526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.148795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53b2c-a9f0-4cad-b9fd-ef5f69aa5d25 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.184257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.186498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.186784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.189679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.236849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 884/1770] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:51:53 2022] POST /identity/v3/projects => generated 401 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:54.238484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.398243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f851b0f-1c5a-4e67-81cb-24a210302700 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.405859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.406699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.406994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.407277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.408057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.412950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.422434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.424155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.453703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 887/1771] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:51:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:51:54.454598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.455301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 885/1772] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:51:54 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:51:54.456737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:54.459104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.485604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c1080-a6dc-4626-8182-e9c82294eab8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.504858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967379e9-e95d-4910-ae07-d1ac48ffd145 service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.517022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.521253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.522632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.522765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.523583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] PATH_INFO: `/v3/projects/3ada95b56aa34c55bb25d592be86d50f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.524485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.524779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.526915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.527490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ada95b56aa34c55bb25d592be86d50f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.527724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.533639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.534038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.568344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 886/1773] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:54.572392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.612624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970b02-2bd0-4e93-87ba-2863b3aa5d1d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:54.653635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:54.655255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:54.673528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:54.675145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] PATH_INFO: `/v3/projects/08b97b6d6db0429dab62adab52883b38/users/0242a8b2c69d47a8987425344d72c9a4/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:54.707774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ada95b56aa34c55bb25d592be86d50f', 'request_id': 'req-20a44d8a-f02f-49e8-9f69-7e5d76081410'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:54.726528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ada95b56aa34c55bb25d592be86d50f', 'request_id': 'req-20a44d8a-f02f-49e8-9f69-7e5d76081410'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:54.744624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b97b6d6db0429dab62adab52883b38, user_id=0242a8b2c69d47a8987425344d72c9a4, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:54.758840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ada95b56aa34c55bb25d592be86d50f', 'request_id': 'req-20a44d8a-f02f-49e8-9f69-7e5d76081410'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:54.772051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:54.825337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] The token cache is being invalidate because project 3ada95b56aa34c55bb25d592be86d50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:51:54.825634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:54.834295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:54.847600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 888/1774] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:54 2022] DELETE /identity/v3/projects/3ada95b56aa34c55bb25d592be86d50f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:54.848809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.851330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:54.852285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 887/1775] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:54 2022] PUT /identity/v3/projects/08b97b6d6db0429dab62adab52883b38/users/0242a8b2c69d47a8987425344d72c9a4/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:54.857118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:54.861971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:54.944443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:55.094195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1a83-fd4c-4f10-ae59-aabeb16bb1f5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:55.112508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:55.114694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:55.115195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:55.115652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:55.116533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:55.118375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:55.139278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 888/1776] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:51:55.143418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:55.144021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44d8a-f02f-49e8-9f69-7e5d76081410 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:55.155295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:55.156028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:55.156316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:55.156614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] PATH_INFO: `/v3/users/98e91d9c4fdf410a96be1ce23c4145ee` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:55.168378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2b0c-3902-40a0-9324-1e6710f3bbd8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:55.170808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e91d9c4fdf410a96be1ce23c4145ee)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:55.173006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:55.198753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:55.202148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:55.202695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:55.203180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] PATH_INFO: `/v3/projects/08b97b6d6db0429dab62adab52883b38/users/0242a8b2c69d47a8987425344d72c9a4/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:55.205550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:55.212781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b97b6d6db0429dab62adab52883b38, user_id=0242a8b2c69d47a8987425344d72c9a4, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:55.224912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861fc3a-158c-498c-9df1-89641fbe54f9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:55.271539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 889/1777] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:51:55 2022] PUT /identity/v3/projects/08b97b6d6db0429dab62adab52883b38/users/0242a8b2c69d47a8987425344d72c9a4/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:55.283884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:55.284495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:55.284978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:55.304263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e91d9c4fdf410a96be1ce23c4145ee'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:55.304960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e91d9c4fdf410a96be1ce23c4145ee'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:55.305583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e91d9c4fdf410a96be1ce23c4145ee'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:55.347942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e91d9c4fdf410a96be1ce23c4145ee'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:55.381601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e91d9c4fdf410a96be1ce23c4145ee'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:55.389657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] MFA Rules not processed for user `0242a8b2c69d47a8987425344d72c9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:55.391148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:55.431005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 889/1778] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:54 2022] DELETE /identity/v3/users/98e91d9c4fdf410a96be1ce23c4145ee => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:55.567104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 890/1779] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:51:55.575374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:55.577151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:55.694748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e1d29-6a63-4f0f-9f86-966d02122ae3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:55.716956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:55.728101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:55.730152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:55.730322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:55.959290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:55.960817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:56.004221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 890/1780] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:56.173388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:56.409117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b456a-99ee-4670-b89a-0113127b9e00 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:56.414224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:56.414926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:56.415275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:56.415555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:56.418109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:56.609836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:56.680108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:56.681568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529f7b6-ad8d-4c8a-9bc9-ef99a78267b8 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:56.711826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 891/1781] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:57.456663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:57.458808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:57.508481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:57.509094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:57.509094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:57.618347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:51:57.626755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:57.750938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:57.825644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b2d-73f5-42b9-8e3f-c225bea7bafd service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:57.848206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:57.849081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:57.849526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:57.850110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] PATH_INFO: `/v3/users/b24a00874f8a4ecea75c5de20ab6b5b7` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:57.852316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24a00874f8a4ecea75c5de20ab6b5b7)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:57.859221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:57.908519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 892/1782] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 26 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:51:58.096387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24a00874f8a4ecea75c5de20ab6b5b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:58.098876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24a00874f8a4ecea75c5de20ab6b5b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:58.107845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24a00874f8a4ecea75c5de20ab6b5b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:58.166156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24a00874f8a4ecea75c5de20ab6b5b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:58.196664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24a00874f8a4ecea75c5de20ab6b5b7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:51:58.217615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 891/1783] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:51:57 2022] DELETE /identity/v3/users/b24a00874f8a4ecea75c5de20ab6b5b7 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:51:58.224366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:58.226763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:58.301488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ddc41-8a66-4753-8334-79feb8fd61df None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:51:58.611544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:51:58.614343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:51:58.614692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:51:58.615176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:51:58.625416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:58.655865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:51:58.658191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:51:58.703711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 893/1784] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:51:59.801469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:51:59.802876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:51:59.991380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782a3c-b23d-4fbf-ac0e-146fded90a4e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:00.000723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:00.002559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:00.002799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:00.003226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] PATH_INFO: `/v3/projects/4b693f8b02e744f8b67cff7c8de8d923` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:00.006663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b693f8b02e744f8b67cff7c8de8d923)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:00.008846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:00.149692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b693f8b02e744f8b67cff7c8de8d923', 'request_id': 'req-ae904b71-2cc6-4bd9-b184-3bf4969405f8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.166676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b693f8b02e744f8b67cff7c8de8d923', 'request_id': 'req-ae904b71-2cc6-4bd9-b184-3bf4969405f8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.177570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b693f8b02e744f8b67cff7c8de8d923', 'request_id': 'req-ae904b71-2cc6-4bd9-b184-3bf4969405f8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.196678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:00.214838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] The token cache is being invalidate because project 4b693f8b02e744f8b67cff7c8de8d923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:00.215137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.218730 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.222650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 892/1785] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:51:59 2022] DELETE /identity/v3/projects/4b693f8b02e744f8b67cff7c8de8d923 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:00.226644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:00.263944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71157-6bce-472b-8e85-d8fbaea8b381 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:00.487581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:00.488297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:00.499839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:00.500402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] PATH_INFO: `/v3/users/e826cddf762646a48a3019afe970ea27` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:00.502147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e826cddf762646a48a3019afe970ea27)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:00.505415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:00.601047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:00.615021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e826cddf762646a48a3019afe970ea27'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.635146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e826cddf762646a48a3019afe970ea27'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.636836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e826cddf762646a48a3019afe970ea27'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.664246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e826cddf762646a48a3019afe970ea27'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.722936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-21909835-9a5c-4d1a-8ca1-d6dee0a85872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e826cddf762646a48a3019afe970ea27'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:00.751342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 894/1786] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:00 2022] DELETE /identity/v3/users/e826cddf762646a48a3019afe970ea27 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:01.534224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:01.535946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:01.564277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904b71-2cc6-4bd9-b184-3bf4969405f8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:01.746466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:01.747525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:01.748038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:01.748532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] PATH_INFO: `/v3/projects/9530a1dbe235418292ad1115b94bdd77` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:01.750068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530a1dbe235418292ad1115b94bdd77)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:01.752272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:01.915548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530a1dbe235418292ad1115b94bdd77', 'request_id': 'req-54ed70e3-2244-488e-86a5-6e5d05918726'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:01.992954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530a1dbe235418292ad1115b94bdd77', 'request_id': 'req-54ed70e3-2244-488e-86a5-6e5d05918726'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:02.031036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530a1dbe235418292ad1115b94bdd77', 'request_id': 'req-54ed70e3-2244-488e-86a5-6e5d05918726'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:02.084076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] The token cache is being invalidate because project 9530a1dbe235418292ad1115b94bdd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:02.086882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:02.090289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-54ed70e3-2244-488e-86a5-6e5d05918726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:02.100026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 893/1787] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:01 2022] DELETE /identity/v3/projects/9530a1dbe235418292ad1115b94bdd77 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:02.104761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc8a6-b1f2-43f3-83c9-9dbe9af307c7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.104761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc8a6-b1f2-43f3-83c9-9dbe9af307c7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.104761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc8a6-b1f2-43f3-83c9-9dbe9af307c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.148788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-204bc8a6-b1f2-43f3-83c9-9dbe9af307c7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:02.150182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-204bc8a6-b1f2-43f3-83c9-9dbe9af307c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:02.332413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.332662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.333090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.419119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] MFA Rules not processed for user `05776e7045fc4e44887cc3cf25e35ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:02.420254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:02.471385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 895/1788] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:02.473828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.474128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.474413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.557935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:02.568123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:02.611079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 894/1789] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:02.622942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:02.623778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 896/1790] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:02.656202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636acb19-09a7-482f-bff5-7bf158e94cfe None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:02.671375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:02.672368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.672813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.673262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.674168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:02.674642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:02.684420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:02.718387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:02.722481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:02.745220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 895/1791] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:02.750982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:02.765227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa56d-3bac-4770-90c5-2b92315cddf2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:02.790805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:02.792076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.792343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.792624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] PATH_INFO: `/v3/projects/c00dd4533d974edaa684db205c206887` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.794051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a196b-67aa-4cf9-b590-5786cb8c5bff admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:02.799908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00dd4533d974edaa684db205c206887)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:02.802384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:02.814305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:02.816821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:02.817577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:02.818214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:02.824082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:02.830329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:02.920454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:02.964657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 896/1792] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:02 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:02.980062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.001529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00dd4533d974edaa684db205c206887', 'request_id': 'req-fb8d1121-d76b-4416-9d21-62e683b73f56'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.024596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00dd4533d974edaa684db205c206887', 'request_id': 'req-fb8d1121-d76b-4416-9d21-62e683b73f56'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.044836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00dd4533d974edaa684db205c206887', 'request_id': 'req-fb8d1121-d76b-4416-9d21-62e683b73f56'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.110417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] The token cache is being invalidate because project c00dd4533d974edaa684db205c206887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:03.111423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.121605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fb8d1121-d76b-4416-9d21-62e683b73f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.130794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 897/1793] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:02 2022] DELETE /identity/v3/projects/c00dd4533d974edaa684db205c206887 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:03.138599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61827f-9ec3-463e-be58-19c25c231a94 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.142738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61827f-9ec3-463e-be58-19c25c231a94 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.144577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61827f-9ec3-463e-be58-19c25c231a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.202553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1567e4-3f07-433a-80c5-548f449f0746 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.222997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-bc61827f-9ec3-463e-be58-19c25c231a94 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:03.230456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.231369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.231987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.232492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.233410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc61827f-9ec3-463e-be58-19c25c231a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.234782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.238573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.269981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 898/1794] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:03.279072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.279793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.280459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.311510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 897/1795] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:02 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:03.312742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.318496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.350068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:03.351397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.366423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58e3e-7f6a-4076-b4d1-c556abc8e2cc admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.378911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 899/1796] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:03.386185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.387010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.387462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.387610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.389929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.393031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.397665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.419294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4035e-7ddf-4900-8dbd-5af2fb158377 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.436829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 898/1797] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:03.437599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.438749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.439388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.439696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.439955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.440659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:03.440968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.447007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.450845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.499744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce0e6-fc94-48bb-a81e-18cc33833a78 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.502118 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 900/1798] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:03.504471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.515374 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:03.522211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.522837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.523139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.523403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] PATH_INFO: `/v3/users/89b75a7a969244b2a3acfb3efa957af2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.526695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b75a7a969244b2a3acfb3efa957af2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.528662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.543095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce2ed-0b16-4a73-83d7-d4e84e2c5312 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.551288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.552435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.552972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.553478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.555457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.558348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.593186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 901/1799] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:03.596743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.627780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400fc43-4280-4e72-9c6f-22ab5015ab56 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.642950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b75a7a969244b2a3acfb3efa957af2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.644223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.644984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.645551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.646059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b75a7a969244b2a3acfb3efa957af2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.646791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b75a7a969244b2a3acfb3efa957af2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.647042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.648874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:03.653799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48b8f9-95ea-4957-a97d-a3bfac34f4ff admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:03.675252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b75a7a969244b2a3acfb3efa957af2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.684769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b75a7a969244b2a3acfb3efa957af2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:03.716293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 899/1800] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:03 2022] DELETE /identity/v3/users/89b75a7a969244b2a3acfb3efa957af2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:03.716640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:03.719362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.737745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 902/1801] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:03 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:03.746334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.750554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:03.750975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:03.835867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:03.851087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:03.854478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:03.867418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd30b2-9d80-4599-b2aa-16a3ffeea1b3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:03.995998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:03.997841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:03.998921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.000198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] PATH_INFO: `/v3/projects/9c76be32fea84daabc4a06667b574e45/users/55700aedf5214ff1bcc661fac7e9bd97/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.042586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c76be32fea84daabc4a06667b574e45, user_id=55700aedf5214ff1bcc661fac7e9bd97, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.050636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67978a1-610e-4a15-b814-3534f45ad20a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.086658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 903/1802] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:04.089472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 900/1803] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:03 2022] PUT /identity/v3/projects/9c76be32fea84daabc4a06667b574e45/users/55700aedf5214ff1bcc661fac7e9bd97/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:04.091289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.099558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:04.105298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.106678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.107187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.122658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d5e7-877e-4943-b374-9d9b9cf8d843 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.207616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] MFA Rules not processed for user `55700aedf5214ff1bcc661fac7e9bd97`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:04.210188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:04.291768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.293223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.293991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.296784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.300465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.305712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc176-3895-4e14-973f-e938e411b480 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.362191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 904/1804] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:04 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:04.366113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.366494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.367170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.371085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 905/1805] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:52:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:52:04.372771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.377536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:04.431060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 901/1806] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:04.434083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.452237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192ece6-87c6-43ee-b670-e13cc14f37e3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.496163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.497726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.498833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.500523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.502257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.507572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.532478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daad809-1d3d-4421-8b0e-356a8d3b49e1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.551475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.552043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.552363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.552633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.565676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 902/1807] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:04.569351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.571349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.578568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.600290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 906/1808] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:04.601216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.608844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9f56-810a-4450-8e19-24a3efa9b1ba admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.610000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:04.628253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.631228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.631540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.631814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.632611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc1e7-2778-49cc-ac3a-d76920dbb7b0 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.632762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.636237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.643912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.644705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.644984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.645431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.646391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.652374 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.676455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 907/1809] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:04.680721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.692387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 903/1810] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:04 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:04.697409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.700389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2a4f-aec8-43b5-912b-85b674adb9e9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.768960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:04.830639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656248d9-94d6-4802-a2ad-0a1706864472 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.837329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.838697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.839071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.839353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.840721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.842741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.846959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:04.847666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.847950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.848225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] PATH_INFO: `/v3/projects/173bc118d00a498c9fbc3f1d1635047c/users/c604e4102ec343d6b440e1b1cd3821e4/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.883833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173bc118d00a498c9fbc3f1d1635047c, user_id=c604e4102ec343d6b440e1b1cd3821e4, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:04.888094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83088b31-1d60-4799-b4e9-96048b1e3cf5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:04.898669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 904/1811] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:04 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:04.903653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:04.923847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 908/1812] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:04 2022] PUT /identity/v3/projects/173bc118d00a498c9fbc3f1d1635047c/users/c604e4102ec343d6b440e1b1cd3821e4/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:04.926336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d986-725e-4521-af0d-6a4994397ad8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:04.926833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d986-725e-4521-af0d-6a4994397ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:04.927170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d986-725e-4521-af0d-6a4994397ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:04.930449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15434a8d-1ebe-4f27-ad61-50b40875f6e2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:04.976074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b335d986-725e-4521-af0d-6a4994397ad8 None None] MFA Rules not processed for user `c604e4102ec343d6b440e1b1cd3821e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:04.977877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b335d986-725e-4521-af0d-6a4994397ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:05.112891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 909/1813] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:05.115000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.115594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.120718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.136345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.139078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.140598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.141041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.143811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.149271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.170151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 905/1814] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:05.171591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.179012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:05.180412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:05.189122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91348-2ae6-4503-b898-d42596c5cc35 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.203448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.204261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.204565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.204821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.205506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.208935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.288997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 906/1815] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:05 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:05.289841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.349122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:05.399777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 910/1816] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:05.404997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.438218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbaf5e-baaa-405f-8795-9f29a7ea8025 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.503021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f8fb-e5b0-4e8c-84d1-88882903879b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.518918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.519796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.520444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.520732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] PATH_INFO: `/v3/projects/f20be5917e1a451e899e9c00826ae136/users/f8ec2581b7bd451abb57bad9b171ab64/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.559519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20be5917e1a451e899e9c00826ae136, user_id=f8ec2581b7bd451abb57bad9b171ab64, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.563420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.593600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 907/1817] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:05 2022] PUT /identity/v3/projects/f20be5917e1a451e899e9c00826ae136/users/f8ec2581b7bd451abb57bad9b171ab64/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:05.594726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.601149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.601769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.602076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.602364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.603048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.607822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.638512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:05.666756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 911/1818] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:05 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:05.671457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.694903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb2cba-e40a-4407-99e1-18fec3419f93 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.750984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf04e-bf4c-4bf8-be03-6c1d632dd768 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.772503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.773203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.773532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.773789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.774636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.787257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.821256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 908/1819] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:05.825545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.845905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629411d0-5363-4c12-8eea-ce1d05144bc5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:05.848867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.848867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.848867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.849172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.850444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.858689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.865626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:05.867418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.868424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.868877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] PATH_INFO: `/v3/projects/f20be5917e1a451e899e9c00826ae136/users/f8ec2581b7bd451abb57bad9b171ab64/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.889361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20be5917e1a451e899e9c00826ae136, user_id=f8ec2581b7bd451abb57bad9b171ab64, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:05.892236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383ebf4-471a-4e98-9cd8-f954eb6d32e0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:05.921475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 912/1820] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:05.922512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:05.961016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 909/1821] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:05 2022] PUT /identity/v3/projects/f20be5917e1a451e899e9c00826ae136/users/f8ec2581b7bd451abb57bad9b171ab64/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:05.970736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:05.970957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:05.971252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:05.976364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44dd78-839a-406d-9083-9901fd4756ea admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:06.103032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] MFA Rules not processed for user `f8ec2581b7bd451abb57bad9b171ab64`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:06.105551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:06.218404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:06.221468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:06.221724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:06.222632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] PATH_INFO: `/v3/projects/59bf02b3203d4552a8a21073679a208c/users/5235441cfadd484aacf36e1d36e9d2b0/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:06.267863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf02b3203d4552a8a21073679a208c, user_id=5235441cfadd484aacf36e1d36e9d2b0, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:06.276249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:06.313593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 913/1822] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:05 2022] PUT /identity/v3/projects/59bf02b3203d4552a8a21073679a208c/users/5235441cfadd484aacf36e1d36e9d2b0/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:06.314813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:06.315230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 910/1823] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:06.316218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:06.325159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:06.341841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:06.348664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce924-7579-4a9e-a71f-738e3fc4e951 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:06.517659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:06.518281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:06.518560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:06.518840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:06.519556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:06.521197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:06.522140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08236db8-563e-4df4-9811-dd97d64a3f0d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:06.537739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:06.538821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:06.539711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:06.539711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] PATH_INFO: `/v3/projects/896c7bd61b7a4923b55ea163f63185a5` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:06.542016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=896c7bd61b7a4923b55ea163f63185a5)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:06.549755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:06.561567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 911/1824] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:06.565684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:06.574383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:06.644905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:06.722995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839707-461c-4fe4-a0bb-fbc1dfe1666f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:06.747467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896c7bd61b7a4923b55ea163f63185a5', 'request_id': 'req-1e0ea551-bdf9-4611-90f7-6325911a3a3f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:06.779161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896c7bd61b7a4923b55ea163f63185a5', 'request_id': 'req-1e0ea551-bdf9-4611-90f7-6325911a3a3f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:06.798381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896c7bd61b7a4923b55ea163f63185a5', 'request_id': 'req-1e0ea551-bdf9-4611-90f7-6325911a3a3f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:06.848852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] The token cache is being invalidate because project 896c7bd61b7a4923b55ea163f63185a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:06.849173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:06.851713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:06.865182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 914/1825] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:06 2022] DELETE /identity/v3/projects/896c7bd61b7a4923b55ea163f63185a5 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:06.867864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:06.877202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:06.882498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:06.883149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:06.883439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:06.883717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:06.889350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:07.040609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:07.045096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:07.060342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 912/1826] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:07.061596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:07.063141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:07.170356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea551-bdf9-4611-90f7-6325911a3a3f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:07.183555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:07.185269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:07.185613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:07.188467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] PATH_INFO: `/v3/projects/59bf02b3203d4552a8a21073679a208c/users/5235441cfadd484aacf36e1d36e9d2b0/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:07.193173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf02b3203d4552a8a21073679a208c, user_id=5235441cfadd484aacf36e1d36e9d2b0, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:07.196084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:07.225271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddb5f-e322-4a29-80de-550ecd9ead56 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:07.238513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 915/1827] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:06 2022] PUT /identity/v3/projects/59bf02b3203d4552a8a21073679a208c/users/5235441cfadd484aacf36e1d36e9d2b0/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:07.239770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:07.247572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:07.289943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:07.357285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:07.423334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:07.425515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:07.427250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:07.427708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] PATH_INFO: `/v3/users/0242a8b2c69d47a8987425344d72c9a4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:07.435480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0242a8b2c69d47a8987425344d72c9a4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:07.456200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:07.587271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88454a-958a-424c-a2da-8f736583e9e9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:07.617552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:07.618240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:07.618527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:07.618808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:07.630855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:07.633066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0242a8b2c69d47a8987425344d72c9a4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:07.636436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0242a8b2c69d47a8987425344d72c9a4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:07.637307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0242a8b2c69d47a8987425344d72c9a4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:07.655518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0242a8b2c69d47a8987425344d72c9a4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:07.665744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e514dc63-1034-4c7e-a86b-dcabf2a704db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0242a8b2c69d47a8987425344d72c9a4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:07.699364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 913/1828] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:07 2022] DELETE /identity/v3/users/0242a8b2c69d47a8987425344d72c9a4 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:07.703088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:07.704038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:07.704482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:07.704969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:07.707905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:07.762416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 916/1829] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:07.812612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] MFA Rules not processed for user `5235441cfadd484aacf36e1d36e9d2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:07.816762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:08.030909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:08.035664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:08.072967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053fe46-46df-4a90-92fd-7de5f1af2b69 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:08.246485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:08.249654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:08.264205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:08.269101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] PATH_INFO: `/v3/users/55700aedf5214ff1bcc661fac7e9bd97` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:08.273545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55700aedf5214ff1bcc661fac7e9bd97)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:08.282108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:08.296969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 914/1830] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:08.312535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:08.316566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:08.488131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55700aedf5214ff1bcc661fac7e9bd97'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:08.519162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55700aedf5214ff1bcc661fac7e9bd97'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:08.522603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55700aedf5214ff1bcc661fac7e9bd97'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:08.542213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:08.576035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55700aedf5214ff1bcc661fac7e9bd97'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:08.601443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e90fc-d774-45ee-9a17-38cc338baf49 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:08.615420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:08.618257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:08.618568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:08.622393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:08.630932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:08.640537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-20583aa1-7f1e-4da6-8c2a-0d5b0866a442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55700aedf5214ff1bcc661fac7e9bd97'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:08.686608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:08.688642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58de4a-0799-4035-b095-1112521cb5a4 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:08.692144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 917/1831] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:08 2022] DELETE /identity/v3/users/55700aedf5214ff1bcc661fac7e9bd97 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:08.699814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9a1-9bb1-4cd4-8cc6-d09a691627d7 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:08.700831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9a1-9bb1-4cd4-8cc6-d09a691627d7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:08.702231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9a1-9bb1-4cd4-8cc6-d09a691627d7 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:08.709398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 918/1832] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:52:08 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:52:08.715541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:08.716207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:08.717062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 915/1833] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:08.720213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:08.825599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:08.828010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:08.989911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:09.060410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 919/1834] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:09.128480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.129091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.130843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.131381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.131518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:09.185067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:09.187200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:09.256621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839d6c-af01-48b6-875d-7ec05fcc42e0 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.261349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.262213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.262504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.262975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.278296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.280340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.294579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 920/1835] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:09.310520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 916/1836] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:09.432183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.446848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.448624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:09.464598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec256c0-71ae-41b5-ad50-12cffc56cdf0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.471399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.472208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.472647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.473011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.485077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.487821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.514024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 917/1837] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:09.563919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdfabb-67b4-4ea2-a30e-34fd6ce3678b service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.569290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5235441cfadd484aacf36e1d36e9d2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59bf02b3203d4552a8a21073679a208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.570091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.570515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.570889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.571704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:09.572371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.574291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.594438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.595155 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 921/1838] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:09.630802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc8d4-d506-48fe-99de-3add3bdf742a service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.639104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.641326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5235441cfadd484aacf36e1d36e9d2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59bf02b3203d4552a8a21073679a208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.642187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.642304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:09.642736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.643179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.644009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.646118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.659635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d96ed-17a0-4828-8a2b-266e1f775903 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.667130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.668063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.668340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.668811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] PATH_INFO: `/v3/projects/08b97b6d6db0429dab62adab52883b38` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.670439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b97b6d6db0429dab62adab52883b38)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.672832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.694612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 918/1839] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:09 2022] POST /identity/v3/projects => generated 354 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:09.699692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:09.753706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b97b6d6db0429dab62adab52883b38', 'request_id': 'req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:09.764684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b97b6d6db0429dab62adab52883b38', 'request_id': 'req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:09.782404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b97b6d6db0429dab62adab52883b38', 'request_id': 'req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:09.783750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:09.806459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] The token cache is being invalidate because project 08b97b6d6db0429dab62adab52883b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:09.807321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:09.808095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e41cb4ea-f3c4-417f-91f5-309cae6f9b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:09.810801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 922/1840] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:09 2022] DELETE /identity/v3/projects/08b97b6d6db0429dab62adab52883b38 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:09.815708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6aaa-aece-438e-adb8-769a1b777cd9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.816618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6aaa-aece-438e-adb8-769a1b777cd9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.816904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6aaa-aece-438e-adb8-769a1b777cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.856422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e691a-c99a-442e-b5b9-b17503daeab6 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:09.871516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-313c6aaa-aece-438e-adb8-769a1b777cd9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:09.873365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-313c6aaa-aece-438e-adb8-769a1b777cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:09.926277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:09.966168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5235441cfadd484aacf36e1d36e9d2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59bf02b3203d4552a8a21073679a208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:09.968992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:09.968992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:09.968992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:09.970156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:09.970482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:09.972787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:09.991425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 919/1841] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:09.992426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.000078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.067188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 923/1842] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:10.076691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.077237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.078281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.122877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5cafe-ea0c-40ec-8fd8-428d7170a6fc tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.133524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:10.134178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.135578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.136615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.137214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.138097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] PATH_INFO: `/v3/projects/9c76be32fea84daabc4a06667b574e45` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.139493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c76be32fea84daabc4a06667b574e45)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.143042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.150736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 924/1843] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:10.150736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.152326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.181191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747d3a-53b8-4efc-af46-498a28c4ed0f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.188276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5235441cfadd484aacf36e1d36e9d2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59bf02b3203d4552a8a21073679a208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.189056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.189397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.189679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] PATH_INFO: `/v3/projects/e97d1d5331e249c189b5614f69eb0211` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.191362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e97d1d5331e249c189b5614f69eb0211)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.194527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.249569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c76be32fea84daabc4a06667b574e45', 'request_id': 'req-0b802b66-49df-4b28-86e8-88140c0bdbad'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.260436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c76be32fea84daabc4a06667b574e45', 'request_id': 'req-0b802b66-49df-4b28-86e8-88140c0bdbad'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.265560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97d1d5331e249c189b5614f69eb0211', 'request_id': 'req-64becc20-d01a-4475-886e-5989fea363b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.273957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c76be32fea84daabc4a06667b574e45', 'request_id': 'req-0b802b66-49df-4b28-86e8-88140c0bdbad'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.277476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97d1d5331e249c189b5614f69eb0211', 'request_id': 'req-64becc20-d01a-4475-886e-5989fea363b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.284127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97d1d5331e249c189b5614f69eb0211', 'request_id': 'req-64becc20-d01a-4475-886e-5989fea363b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.294576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] The token cache is being invalidate because project 9c76be32fea84daabc4a06667b574e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:10.294871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.295595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.296913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] The token cache is being invalidate because project e97d1d5331e249c189b5614f69eb0211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:10.299930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 920/1844] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:09 2022] DELETE /identity/v3/projects/9c76be32fea84daabc4a06667b574e45 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:10.300074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.300172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.300258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.300350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.300441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 925/1845] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:10 2022] DELETE /identity/v3/projects/e97d1d5331e249c189b5614f69eb0211 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:10.302897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.304515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.394307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802b66-49df-4b28-86e8-88140c0bdbad admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.423113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:10.428837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64becc20-d01a-4475-886e-5989fea363b0 tempest-VolumeQuotaClassesTest-1732450727 tempest-VolumeQuotaClassesTest-1732450727-project-admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.436368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.436994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.437293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.439352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] PATH_INFO: `/v3/users/f8ec2581b7bd451abb57bad9b171ab64` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.440194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ec2581b7bd451abb57bad9b171ab64)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.442188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.459290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:10.507423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.508634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.509512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.510620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.512465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:10.512972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.515924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.525881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ec2581b7bd451abb57bad9b171ab64'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.536323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 921/1846] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:10.541718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ec2581b7bd451abb57bad9b171ab64'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.551281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.552284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ec2581b7bd451abb57bad9b171ab64'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.554993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.578861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beee55-e7f8-4b6f-b2e0-d0d05a463f72 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.581635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ec2581b7bd451abb57bad9b171ab64'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.584487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.585291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.586277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.586682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.587472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.590790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.615085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ec2581b7bd451abb57bad9b171ab64'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.624054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 926/1847] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:10 2022] DELETE /identity/v3/users/f8ec2581b7bd451abb57bad9b171ab64 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:10.639551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 922/1848] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:10 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:10.644509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.664372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.667050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.731430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd239d-c6d7-406f-a38b-699800b3c68b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.758567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1583-0614-408b-897b-21856c191d6d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.764990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.765971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.766175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.766508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] PATH_INFO: `/v3/users/c604e4102ec343d6b440e1b1cd3821e4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.767934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c604e4102ec343d6b440e1b1cd3821e4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.770530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.833464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.834314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.834839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.835119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.835802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.839206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.863247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c604e4102ec343d6b440e1b1cd3821e4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.865683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c604e4102ec343d6b440e1b1cd3821e4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.867509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c604e4102ec343d6b440e1b1cd3821e4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.880930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 927/1849] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:10 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:10.882379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.884542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.898553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4cf6-6a47-495c-8100-c91ce159b0ae admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.900970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c604e4102ec343d6b440e1b1cd3821e4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.904407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:10.905036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.905321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.905599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.906650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:10.908098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:10.916794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ed16ed17-7fb4-4d64-99d1-4b467f3fdf6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c604e4102ec343d6b440e1b1cd3821e4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:10.923561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 928/1850] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:10.928645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:10.946175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 923/1851] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:10 2022] DELETE /identity/v3/users/c604e4102ec343d6b440e1b1cd3821e4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:10.948095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:10.948642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:10.949094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:10.954607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e412-0b51-4183-a321-42726b73db18 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:10.973499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:10.974946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:10.981120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:10.982108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:11.071829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 924/1852] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:11.078883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.079523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.079811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.080090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.080856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.081974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.082494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.083581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.094891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 929/1853] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:11.098776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.110210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdd4eb-610f-457d-80c7-d3d3606e5c44 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.116219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.116886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.117166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.117444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] PATH_INFO: `/v3/projects/c9ec20a6441949c2b2cbbbfb2a922031/users/052e8a19c36a47e5b3bf1006251ca5d0/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.134306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ec20a6441949c2b2cbbbfb2a922031, user_id=052e8a19c36a47e5b3bf1006251ca5d0, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.137505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d915e6-4773-4fe3-a51f-0a93f85be411 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.150794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106f49-e9a5-4711-8e77-01ffaba986ff None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.153095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 930/1854] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:11 2022] PUT /identity/v3/projects/c9ec20a6441949c2b2cbbbfb2a922031/users/052e8a19c36a47e5b3bf1006251ca5d0/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:11.163229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a25ae-c725-4595-ad60-943dc024017c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.163518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a25ae-c725-4595-ad60-943dc024017c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.163795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a25ae-c725-4595-ad60-943dc024017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.217660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-264a25ae-c725-4595-ad60-943dc024017c None None] MFA Rules not processed for user `052e8a19c36a47e5b3bf1006251ca5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:11.219158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-264a25ae-c725-4595-ad60-943dc024017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.249025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.249739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.250912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.251218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.317992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 931/1855] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:11.322262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a25ae-c725-4595-ad60-943dc024017c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.323730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-264a25ae-c725-4595-ad60-943dc024017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.331931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.333989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.337261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a25ae-c725-4595-ad60-943dc024017c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.342815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.343584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.343926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.344154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] PATH_INFO: `/v3/projects/f20be5917e1a451e899e9c00826ae136` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.345908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20be5917e1a451e899e9c00826ae136)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.347708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.348778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 925/1856] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:11.350197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.376727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dead-9707-4369-801c-75e786ef392d service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.382567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.383321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.383612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.383892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.385442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.387367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.403075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20be5917e1a451e899e9c00826ae136', 'request_id': 'req-e29cadb2-164e-4367-b20a-014b92e200ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.404267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:11.412797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20be5917e1a451e899e9c00826ae136', 'request_id': 'req-e29cadb2-164e-4367-b20a-014b92e200ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.421119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 926/1857] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:11.425347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.425506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20be5917e1a451e899e9c00826ae136', 'request_id': 'req-e29cadb2-164e-4367-b20a-014b92e200ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.443699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:11.452976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] The token cache is being invalidate because project f20be5917e1a451e899e9c00826ae136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:11.453282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.454387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e29cadb2-164e-4367-b20a-014b92e200ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.456394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 932/1858] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:11 2022] DELETE /identity/v3/projects/f20be5917e1a451e899e9c00826ae136 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:11.461003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.461296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.461642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.487397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:11.488762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.537649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7cc5-f0ff-452c-b9eb-5ce38ba2c548 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.543307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.543938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.544222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.544500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.545201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.555692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d9bb-b3ae-4d30-a366-fb6b69415b54 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.595329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 927/1859] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:11.604060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 933/1860] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:11.604060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.604060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.606375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.606723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.607029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.627875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975fb11-f28a-4d81-9f80-def53084379f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.637488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.637488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.637488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.637776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.638528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:11.638696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.639769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.640771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.648857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 928/1861] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:11.653951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.660964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 934/1862] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:11.665261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.668131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041b538-93ea-41fc-968a-d8b082de8d0b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.680231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.680548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260dac-8b4c-4674-bd05-d730600a6666 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.682524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.682835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.683130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.683861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:11.684172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.686749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.687427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.687787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.688021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] PATH_INFO: `/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80/users/8c895437bdcc41d58f96c5210ae40b8c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.688701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.707937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 929/1863] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:11.711290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.715088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.716945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1fb2bdfc9641fbb43d367f5e1dee80, user_id=8c895437bdcc41d58f96c5210ae40b8c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.720362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.734675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e1c3-1a9c-461f-be1c-1f58a9f8990e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.741080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.741717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.742140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.742529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] PATH_INFO: `/v3/projects/173bc118d00a498c9fbc3f1d1635047c` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.744273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=173bc118d00a498c9fbc3f1d1635047c)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.746516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.750085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 935/1864] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:11 2022] PUT /identity/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80/users/8c895437bdcc41d58f96c5210ae40b8c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:11.750861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.838871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fa91-d854-417b-a132-929d362e0a7f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.844707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173bc118d00a498c9fbc3f1d1635047c', 'request_id': 'req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.858087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173bc118d00a498c9fbc3f1d1635047c', 'request_id': 'req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.870032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173bc118d00a498c9fbc3f1d1635047c', 'request_id': 'req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.889217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] The token cache is being invalidate because project 173bc118d00a498c9fbc3f1d1635047c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:11.889550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.890502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:11.892073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 930/1865] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:11 2022] DELETE /identity/v3/projects/173bc118d00a498c9fbc3f1d1635047c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:11.893004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.894385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:11.925048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:11.925864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:11.926249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:11.927057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:11.928171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:11.934459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:11.964812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:11.965023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:11.987102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f82ac-525b-4202-9a8d-dc0f1f070d1e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:11.988301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 936/1866] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:11 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:11.989417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:11.991216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.070749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cfbb-7f0c-447e-876d-50759b0b6daa admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.076536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.077199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.077490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.077769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] PATH_INFO: `/v3/users/5235441cfadd484aacf36e1d36e9d2b0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.079462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5235441cfadd484aacf36e1d36e9d2b0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.082152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.105747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.106409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.106698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.106979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.107685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.109390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.125118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 931/1867] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:12.125989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.133972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.146440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0f08d-ac2c-4d0e-8aa5-dbb3a19cc954 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.147227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5235441cfadd484aacf36e1d36e9d2b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.151276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.151894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.152183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.152543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.153267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.155305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.156389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5235441cfadd484aacf36e1d36e9d2b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.157053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5235441cfadd484aacf36e1d36e9d2b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.164269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5235441cfadd484aacf36e1d36e9d2b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.179636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5235441cfadd484aacf36e1d36e9d2b0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.183859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 932/1868] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:12 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:12.184795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.186681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.187415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 937/1869] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:11 2022] DELETE /identity/v3/users/5235441cfadd484aacf36e1d36e9d2b0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:12.188270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.189536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.200461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984a5f-4993-42d4-a303-a91314d488e6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.277949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.279027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.279506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.279735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] PATH_INFO: `/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80/users/8c895437bdcc41d58f96c5210ae40b8c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.283199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1fb2bdfc9641fbb43d367f5e1dee80, user_id=8c895437bdcc41d58f96c5210ae40b8c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.286544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db963fb-7bf1-4228-b53b-9ea067ee982c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.295886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349ee-a4cf-44f2-943e-b9cdcef2b87a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.303333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 933/1870] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:12 2022] PUT /identity/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80/users/8c895437bdcc41d58f96c5210ae40b8c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:12.317019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.317464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.317886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.320908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:12.362399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] MFA Rules not processed for user `8c895437bdcc41d58f96c5210ae40b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:12.363687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.381081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.381741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.382036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.382303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.383007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.384643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.401415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 938/1871] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:12.408298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.428799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3e5d-32e6-459c-aa45-d272f4d25ba6 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.444940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.445847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.446224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.447529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.448305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.450084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.465076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 939/1872] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:12.467349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:12.469128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.481989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadb307-155e-4e74-bce3-0c630e9b6306 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.488393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.489193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 934/1873] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:12.489312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.489455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.489952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] PATH_INFO: `/v3/projects/3109203536c141ec947f58c18f9ad601/users/3b89b27a19104891aea0a506ff250891/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.503593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.505906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.508114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3109203536c141ec947f58c18f9ad601, user_id=3b89b27a19104891aea0a506ff250891, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.512350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938fff-ce42-4cdc-b6b7-ed2839e65a9a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.538050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 940/1874] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:12 2022] PUT /identity/v3/projects/3109203536c141ec947f58c18f9ad601/users/3b89b27a19104891aea0a506ff250891/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:12.541007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.541408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.541792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.584892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] MFA Rules not processed for user `3b89b27a19104891aea0a506ff250891`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:12.588130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.596833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49601929-7833-4eb1-bbdf-f8dc8842838e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.683943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.685069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.685413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.685977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.705261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 941/1875] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:12.706546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.707898 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.766406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.767933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.778444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 935/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:12.779296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.786658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b64ec-8647-4c22-b530-29a71947722e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.790409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22017-1072-42bf-8280-24bd536a7631 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.792773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.793492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.793910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.794289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] PATH_INFO: `/v3/projects/59bf02b3203d4552a8a21073679a208c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.795552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bf02b3203d4552a8a21073679a208c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.795735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.796353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.796635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.796922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.797584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.798080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.799807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:12.816570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:12.841121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 936/1877] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:12 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:12.842604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.858498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bf02b3203d4552a8a21073679a208c', 'request_id': 'req-04f8ed71-1afd-4355-8ba2-f5cec352b462'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.866775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bf02b3203d4552a8a21073679a208c', 'request_id': 'req-04f8ed71-1afd-4355-8ba2-f5cec352b462'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.878004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bf02b3203d4552a8a21073679a208c', 'request_id': 'req-04f8ed71-1afd-4355-8ba2-f5cec352b462'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.890396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:12.891079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] The token cache is being invalidate because project 59bf02b3203d4552a8a21073679a208c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:12.891474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.892233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:12.893842 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 942/1878] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:12 2022] DELETE /identity/v3/projects/59bf02b3203d4552a8a21073679a208c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:12.897562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:12.898455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.918308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a30fa8-cc89-468a-97d2-6deaa1e391b6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.955413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ed71-1afd-4355-8ba2-f5cec352b462 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:12.959379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.959944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.960404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.960806 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.963547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:12.979037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:12.979759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:12.980102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:12.980452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:12.981231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:12.983268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275017f7-14a2-4db4-bb34-4eafff356268 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.007460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 937/1879] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:12 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:13.008743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8868-8f20-481e-a37d-056e24678784 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.009025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8868-8f20-481e-a37d-056e24678784 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.009938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8868-8f20-481e-a37d-056e24678784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.032743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-966c8868-8f20-481e-a37d-056e24678784 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:13.033743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.033985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-966c8868-8f20-481e-a37d-056e24678784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.036546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b76c-eb91-4e6d-bf18-145fcb54c8a4 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.048500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 938/1880] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:13.048500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c8868-8f20-481e-a37d-056e24678784 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.048500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-966c8868-8f20-481e-a37d-056e24678784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.055535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 943/1881] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:13.057833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.057978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c8868-8f20-481e-a37d-056e24678784 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.059128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.059128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.064033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.064850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.065134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.065413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.066268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.067788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.084271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:13.084865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 939/1882] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:13.086009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.091693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.101929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 944/1883] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:13.105196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb049fc4-dfd1-499d-bedc-c98ab38e44dc admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.106404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.114101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.114999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.115231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.115593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] PATH_INFO: `/v3/projects/b4424b971a154119a2f41db5a515288e/users/349304f3e65e4a84b870d74f610a9e19/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.120226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa9c9-17aa-4c2d-be4c-65b9a0fba946 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.125502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.126499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.126787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.127063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.127766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:13.128073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.129858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.140222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4424b971a154119a2f41db5a515288e, user_id=349304f3e65e4a84b870d74f610a9e19, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.144751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.154163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 945/1884] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:13.162484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.177471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899248-758c-4b11-8189-c9d15b0efddc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.180428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 940/1885] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:13 2022] PUT /identity/v3/projects/b4424b971a154119a2f41db5a515288e/users/349304f3e65e4a84b870d74f610a9e19/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:13.182154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.257740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:13.288088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.289207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.289415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f40036-87a4-4463-9273-4eb04a621a0c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.289772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.290179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.291685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.294153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.297294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.298220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.298581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.301770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.302572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.304508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.319074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 941/1886] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:13.323677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.335274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 946/1887] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:13.337963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.343673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89712c-a214-424e-b244-eab18ae94427 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.378263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:13.438311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.439011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.439294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.439580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] PATH_INFO: `/v3/projects/b4424b971a154119a2f41db5a515288e/users/349304f3e65e4a84b870d74f610a9e19/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.440616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa567db-0d64-4cf4-aa40-cd42f19bb9e5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.443698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4424b971a154119a2f41db5a515288e, user_id=349304f3e65e4a84b870d74f610a9e19, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.447502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.448516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.448716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.449177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.449548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.450370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.452739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1e3ef-f665-40f0-8712-b85bfc64e140 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.464139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 942/1888] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:13 2022] PUT /identity/v3/projects/b4424b971a154119a2f41db5a515288e/users/349304f3e65e4a84b870d74f610a9e19/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:13.465197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.467190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.490573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 947/1889] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:13.491717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.492009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.492277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.538916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] MFA Rules not processed for user `349304f3e65e4a84b870d74f610a9e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:13.540203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.590599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3d7e2-6ebe-4dbe-86f9-fcfa25317189 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.596018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.596742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.597034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.597318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] PATH_INFO: `/v3/users/052e8a19c36a47e5b3bf1006251ca5d0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.599273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=052e8a19c36a47e5b3bf1006251ca5d0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.601415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.655410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 948/1890] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:13.655410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.741093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052e8a19c36a47e5b3bf1006251ca5d0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:13.741871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052e8a19c36a47e5b3bf1006251ca5d0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:13.743547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052e8a19c36a47e5b3bf1006251ca5d0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:13.755472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23cdd-d55d-47db-825b-0d02e8457332 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.786402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.787447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.788576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.788576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.796294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.796294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.797396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052e8a19c36a47e5b3bf1006251ca5d0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:13.808460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052e8a19c36a47e5b3bf1006251ca5d0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:13.822612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 949/1891] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:13.823549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.825959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.831300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 943/1892] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:13 2022] DELETE /identity/v3/users/052e8a19c36a47e5b3bf1006251ca5d0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:13.832099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:13.833455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.876178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:13.894998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:13.918241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0c0a-6921-48ec-921b-555c81e5c33f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.930638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f620a8-466d-47a3-8458-82a24e60d14c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:13.937849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.938833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.939437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.939770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.941778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:13.944203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41e8e-afbc-497e-b3db-3c649b73dbdf admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:13.958990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 944/1893] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:13.960963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.961260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.962323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.984213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:13.985385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:13.985667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:13.986034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:13.988556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:13.992961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:13.995779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.007346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 945/1894] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:14.008965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.049069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060af11-9782-4920-bece-eb3e6904e006 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.064696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.065409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.065694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.068380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] PATH_INFO: `/v3/projects/42e446788a2e4b3eb20501b6b958d402/users/c46a602335df4739992d8fee06148f0a/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.069279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.075493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.103692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 950/1895] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:14.105322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.106137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e446788a2e4b3eb20501b6b958d402, user_id=c46a602335df4739992d8fee06148f0a, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.108880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cb746-5d69-4342-9737-c5816f3ad516 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.112291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.151278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 946/1896] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:14 2022] PUT /identity/v3/projects/42e446788a2e4b3eb20501b6b958d402/users/c46a602335df4739992d8fee06148f0a/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:14.169833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.171525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.171971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.200285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565048-a801-4284-8ea6-8bd66cf6f556 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.244971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] MFA Rules not processed for user `c46a602335df4739992d8fee06148f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:14.246944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.258984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.260000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.260341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.260624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.266508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:14.351735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 947/1897] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:14.358410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.368475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.371428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.378760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59923841-24f6-4571-9e79-7166d64a90d1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.385453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.386277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.386663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.387043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.387823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.388813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 951/1898] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:14.389789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.390252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.392303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.412077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42202aa7-8560-4989-a160-5c2964ec4e34 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.419377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.420266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.420693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.421114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] PATH_INFO: `/v3/users/3b89b27a19104891aea0a506ff250891` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.423307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b89b27a19104891aea0a506ff250891)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.427514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 948/1899] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:14 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:14.427668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.428618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.528255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b89b27a19104891aea0a506ff250891'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:14.543810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b89b27a19104891aea0a506ff250891'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:14.544721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b89b27a19104891aea0a506ff250891'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:14.550077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca00d7-bd16-4878-a117-df3ba418d2b3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.562059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b89b27a19104891aea0a506ff250891'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:14.574881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.575872 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.576481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.577037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.577903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.581143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.616190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d0720dfe-fb6a-40b9-892d-665ae65fe971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b89b27a19104891aea0a506ff250891'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:14.627253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 952/1900] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:14 2022] DELETE /identity/v3/users/3b89b27a19104891aea0a506ff250891 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:14.633395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.633751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.634142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.635805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 949/1901] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:14 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:14.639079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.641747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.661851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:14.670827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:14.673109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.676122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb6b8c-a616-4328-9ff6-395be1d91289 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.782126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 953/1902] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:14.783955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.784613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.784902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.785680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.786444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.788067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.807946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 950/1903] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:14.811428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.813419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:14.820115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.841966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:14.846065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0d97-3db0-4525-9641-8e08b0fcbd4e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:14.866662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:14.868924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:14.870192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:14.871925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] PATH_INFO: `/v3/projects/b2ae2af4c47a4c41a958395258019f81/users/4c1b417a37f04386a3e407d6297c3d7c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:14.905393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ae2af4c47a4c41a958395258019f81, user_id=4c1b417a37f04386a3e407d6297c3d7c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:14.908438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:14.927764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 951/1904] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:14 2022] PUT /identity/v3/projects/b2ae2af4c47a4c41a958395258019f81/users/4c1b417a37f04386a3e407d6297c3d7c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:14.931905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:14.966493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3669cf-9b54-454c-a84f-f1f8feb34210 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.051065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ae021-76eb-4458-b3f7-a0a80fdf3ffb admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.054515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.055907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.057072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.057573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.057857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.058174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.058283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.058637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.059419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.061108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539a4db-7a65-415b-ada3-c50845fd32f0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.075372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.076827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.087534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 954/1905] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:15.092845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 952/1906] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:15.097638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.110014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeecf1-be65-47a5-a38a-6440aeb937fa service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.117122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.117953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.118338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.119001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] PATH_INFO: `/v3/projects/b2ae2af4c47a4c41a958395258019f81/users/4c1b417a37f04386a3e407d6297c3d7c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.121710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ae2af4c47a4c41a958395258019f81, user_id=4c1b417a37f04386a3e407d6297c3d7c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.124935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.164037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 955/1907] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:15 2022] PUT /identity/v3/projects/b2ae2af4c47a4c41a958395258019f81/users/4c1b417a37f04386a3e407d6297c3d7c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:15.175098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.175387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.176269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.208222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] MFA Rules not processed for user `4c1b417a37f04386a3e407d6297c3d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:15.209979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:15.288618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:15.305947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 953/1908] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:15.321850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.324605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:15.427061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.429653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:15.433330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b071b-dedd-4d73-bd50-a3f52c07e57e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.439519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.441713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.441713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.442073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.455971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.458604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.483405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 956/1909] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:15.566452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831d7e7-31c7-4e82-87c9-6f361a2d98b3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.580680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.581725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.582077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.582357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] PATH_INFO: `/v3/projects/c9ec20a6441949c2b2cbbbfb2a922031` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.584721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ec20a6441949c2b2cbbbfb2a922031)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.588759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.609425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.621768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942f8c-2409-4f94-ba97-b8d5bce4475c service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.630754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.631496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.632138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.632491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.634783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:15.701571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ec20a6441949c2b2cbbbfb2a922031', 'request_id': 'req-caa1d544-5a3e-42d4-8f2a-7263a99a764b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:15.720710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ec20a6441949c2b2cbbbfb2a922031', 'request_id': 'req-caa1d544-5a3e-42d4-8f2a-7263a99a764b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:15.736633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ec20a6441949c2b2cbbbfb2a922031', 'request_id': 'req-caa1d544-5a3e-42d4-8f2a-7263a99a764b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:15.751922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] The token cache is being invalidate because project c9ec20a6441949c2b2cbbbfb2a922031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:15.752355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:15.754539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:15.759290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 954/1910] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:15 2022] DELETE /identity/v3/projects/c9ec20a6441949c2b2cbbbfb2a922031 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:15.760221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.761656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:15.789479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.795283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.808468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:15.826837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 957/1911] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:15.827789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:15.854764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688f03-2b8e-4adb-a318-321e1209e318 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.938747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1d544-5a3e-42d4-8f2a-7263a99a764b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:15.955707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.956386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.957422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.957422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] PATH_INFO: `/v3/projects/3109203536c141ec947f58c18f9ad601` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:15.959482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3109203536c141ec947f58c18f9ad601)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:15.961763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:15.983285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:15.984349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:15.984794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:15.985213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] PATH_INFO: `/v3/users/8c895437bdcc41d58f96c5210ae40b8c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:16.006721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c895437bdcc41d58f96c5210ae40b8c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:16.008816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:16.049725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:16.088838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3109203536c141ec947f58c18f9ad601', 'request_id': 'req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.089620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c895437bdcc41d58f96c5210ae40b8c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.100450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3109203536c141ec947f58c18f9ad601', 'request_id': 'req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.101241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c895437bdcc41d58f96c5210ae40b8c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.102949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c895437bdcc41d58f96c5210ae40b8c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.113686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3109203536c141ec947f58c18f9ad601', 'request_id': 'req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.116815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c895437bdcc41d58f96c5210ae40b8c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.130816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] The token cache is being invalidate because project 3109203536c141ec947f58c18f9ad601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:16.131109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.132154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.132838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c895437bdcc41d58f96c5210ae40b8c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.133857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 955/1912] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:15 2022] DELETE /identity/v3/projects/3109203536c141ec947f58c18f9ad601 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:16.137925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:16.139308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:16.141932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 958/1913] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:15 2022] DELETE /identity/v3/users/8c895437bdcc41d58f96c5210ae40b8c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:16.285770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbf2ad-eb33-4ea9-8f58-0e2b9db1f6a0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:16.411473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:16.413312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:16.413637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:16.413952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] PATH_INFO: `/v3/users/349304f3e65e4a84b870d74f610a9e19` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:16.415171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349304f3e65e4a84b870d74f610a9e19)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:16.419078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:16.515432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349304f3e65e4a84b870d74f610a9e19'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.519207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349304f3e65e4a84b870d74f610a9e19'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.520002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349304f3e65e4a84b870d74f610a9e19'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.537431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349304f3e65e4a84b870d74f610a9e19'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.540965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:16.553963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b23905d6-27e6-42fd-ba1a-19ec3957b151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349304f3e65e4a84b870d74f610a9e19'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.590383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 956/1914] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:16 2022] DELETE /identity/v3/users/349304f3e65e4a84b870d74f610a9e19 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:16.688148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:16.692841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:16.726107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc308-6a29-4239-b56a-b8342bcaf51c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:16.835183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:16.836185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:16.836687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:16.836974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] PATH_INFO: `/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:16.838759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1fb2bdfc9641fbb43d367f5e1dee80)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:16.840693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:16.868130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:16.898066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1fb2bdfc9641fbb43d367f5e1dee80', 'request_id': 'req-484556d4-afb8-410c-a136-6d662fcfb9ed'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.908087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1fb2bdfc9641fbb43d367f5e1dee80', 'request_id': 'req-484556d4-afb8-410c-a136-6d662fcfb9ed'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.914786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1fb2bdfc9641fbb43d367f5e1dee80', 'request_id': 'req-484556d4-afb8-410c-a136-6d662fcfb9ed'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.926774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] The token cache is being invalidate because project fc1fb2bdfc9641fbb43d367f5e1dee80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:16.927061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.927716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:16.929422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 959/1915] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:16 2022] DELETE /identity/v3/projects/fc1fb2bdfc9641fbb43d367f5e1dee80 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:16.936751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60725b4-0ff6-4846-aaa0-a524dbfc80fe None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:16.937256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60725b4-0ff6-4846-aaa0-a524dbfc80fe None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:16.937361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60725b4-0ff6-4846-aaa0-a524dbfc80fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:16.957120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:16.958717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:16.960083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-d60725b4-0ff6-4846-aaa0-a524dbfc80fe None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:16.962986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d60725b4-0ff6-4846-aaa0-a524dbfc80fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:17.070222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484556d4-afb8-410c-a136-6d662fcfb9ed admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.076537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.077358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.078412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.078815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] PATH_INFO: `/v3/projects/b4424b971a154119a2f41db5a515288e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.080406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4424b971a154119a2f41db5a515288e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.083432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.143137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4424b971a154119a2f41db5a515288e', 'request_id': 'req-e163bfa4-6452-4192-bd6f-c6d56f372612'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:17.143611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 957/1916] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:17.151123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.152032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.152667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.156692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4424b971a154119a2f41db5a515288e', 'request_id': 'req-e163bfa4-6452-4192-bd6f-c6d56f372612'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:17.164759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4424b971a154119a2f41db5a515288e', 'request_id': 'req-e163bfa4-6452-4192-bd6f-c6d56f372612'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:17.180782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:17.182119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] The token cache is being invalidate because project b4424b971a154119a2f41db5a515288e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:17.182550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:17.183254 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:17.184096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e163bfa4-6452-4192-bd6f-c6d56f372612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:17.190134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 960/1917] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:16 2022] DELETE /identity/v3/projects/b4424b971a154119a2f41db5a515288e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:17.191795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a26c14-a71d-4505-80e3-de27ab658145 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.192179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a26c14-a71d-4505-80e3-de27ab658145 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.193433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a26c14-a71d-4505-80e3-de27ab658145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.218870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b9a26c14-a71d-4505-80e3-de27ab658145 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:17.220138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b9a26c14-a71d-4505-80e3-de27ab658145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:17.258720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 958/1918] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:17.261550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:17.263663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.278376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf62ace-61e3-44dc-ae74-7a70e989c413 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.285973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.286614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.286902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.287183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.288026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:17.288345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.291861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.300770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 961/1919] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:17.302764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.303200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.303690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.310261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 959/1920] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:17.314947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.326096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ead97-77e2-440d-b620-dfc539e4ce9d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.328720 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:17.330127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:17.333080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.333838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.334237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.334619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.335633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.338602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.359641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 962/1921] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:17.364173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.375951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9337-d2ab-4d4d-bd98-16f91ef22ab7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.381149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 960/1922] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:17.385854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.386198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.386492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.386822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.387045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.387758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:17.388064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.389661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.410103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 963/1923] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:17.413846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.434074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260869-9198-4082-af26-d6967b2cbc4d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.450947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:17.471694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d112c-dfcd-4a9d-b70e-cf5a114da530 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.482958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.484460 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.485952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.486864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.488249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.491499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.533429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 961/1924] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:17.534415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.540157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.542042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.542042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.542211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.542748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.547195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.547510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d5d7-863b-4f37-a455-7646c99c6d50 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.553406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.554405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.554916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.555283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.556213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.558778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.573992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 962/1925] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:17.575769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.593533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0ce3-6637-40a2-9cda-661a4050b60d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.600956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.602049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.602583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.603116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.604499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.607133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.615827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 964/1926] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:17.620802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.626352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 963/1927] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:17.627464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.640021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63e3d-5434-404f-b41b-ff59f3aa5c6c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.741741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.742719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.743070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.746928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] PATH_INFO: `/v3/projects/cf35271c00fe482f8e32f637f920c2d0/users/1f8f1e74781042628455d6b85c603a96/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.760954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712f47-8812-4a0c-9e64-3e56c0f98cf8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.782185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:17.782839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.783126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.783407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.784112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.796834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf35271c00fe482f8e32f637f920c2d0, user_id=1f8f1e74781042628455d6b85c603a96, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:17.798356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.799805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8a67f-071a-4785-a088-872f9a020388 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:17.821037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 964/1928] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:17 2022] PUT /identity/v3/projects/cf35271c00fe482f8e32f637f920c2d0/users/1f8f1e74781042628455d6b85c603a96/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:17.834320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:17.834734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:17.835201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:17.868182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 965/1929] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:17.873221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:17.908237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f9-e03c-4fc5-a3f7-d5d9c6db6371 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:17.910968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] MFA Rules not processed for user `1f8f1e74781042628455d6b85c603a96`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:17.913154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:17.979579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:18.030973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.031715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.032294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.032643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.033421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.036010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.064161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 966/1930] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:18.077662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.079585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 965/1931] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:18.096592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.100247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:18.104467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd01ac-02e3-4b02-9ef8-b50da84e40ac admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:18.121869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.122823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.123199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.123574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.124673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.127317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.141314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 967/1932] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:18.145520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.162530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:18.170845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959771-8365-458b-9318-d7a335c9f373 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:18.189069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.190740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.191436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.192429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] PATH_INFO: `/v3/projects/55987b496ddf4d448878c3615ac3e690/users/90cd20ee035348268d8bd6f643db50ac/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.216759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08abc-56f8-4658-a4c7-d1935f2ec1ff None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:18.226541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.227305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.227559 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.230249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55987b496ddf4d448878c3615ac3e690, user_id=90cd20ee035348268d8bd6f643db50ac, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.231745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.234293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474541f-251e-45bb-b9ad-b8d682a81c0b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.266510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.267982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed953f-0efb-46cb-b383-3bdf61e208a4 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.272722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 968/1933] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:18 2022] PUT /identity/v3/projects/55987b496ddf4d448878c3615ac3e690/users/90cd20ee035348268d8bd6f643db50ac/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:18.274400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a9b0-714d-4e00-8c68-c295fcc74ccd None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.274707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a9b0-714d-4e00-8c68-c295fcc74ccd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.275022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a9b0-714d-4e00-8c68-c295fcc74ccd None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.277933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 969/1934] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:52:18.287443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.287797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.288063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.293418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 966/1935] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:18.301007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.301336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.301606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.387977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:18.393792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:18.413177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] MFA Rules not processed for user `90cd20ee035348268d8bd6f643db50ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:18.414452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:18.576602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 967/1936] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:18.580020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.584480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:18.601245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 970/1937] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:18.607223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.798406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0723e2d-0094-466a-a307-1cc1236c7bed None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:18.824326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.824326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.824326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.824326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] PATH_INFO: `/v3/users/eb2df8bf12c6477d9d01e0554bae61e2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.829633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2df8bf12c6477d9d01e0554bae61e2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.831778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.836657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2149-6dc3-4b0d-9dd9-9abf9d005bc7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:18.849273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:18.850265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:18.850651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:18.851034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:18.851815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:18.856670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:18.926221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 971/1938] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:18 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:18.928310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:18.936197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:18.963731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2df8bf12c6477d9d01e0554bae61e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:18.964794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2df8bf12c6477d9d01e0554bae61e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:18.966177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2df8bf12c6477d9d01e0554bae61e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:18.971478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:19.001482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2df8bf12c6477d9d01e0554bae61e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:19.003022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:19.012673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2df8bf12c6477d9d01e0554bae61e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:19.040091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 968/1939] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:18 2022] DELETE /identity/v3/users/eb2df8bf12c6477d9d01e0554bae61e2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:19.041779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.044971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.103799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5c18-b9c8-45d4-b4f2-34cf69828686 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.162622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200de3-e69d-4af3-a716-de7e29e127ea admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.168692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.169441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.170370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.170661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.171342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.173541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f9c9a-1940-4e8f-a71b-a7dcefc7d6b4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.202998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 969/1940] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:19 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:19.204614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.204791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.205033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.205250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.205435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.205537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.205926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.213560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.232557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:19.233792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.249028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 970/1941] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:19.249028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.249370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.250763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.256204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e027e2-278d-421c-aa85-c1380f70e492 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.261881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.262612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.263147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.263274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 972/1942] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:19.263356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.263793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.264216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.266067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.266849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.278827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 971/1943] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:19.283209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.304044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f393-0d58-4ee5-b884-5c52dc5e7ac8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.311095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.312002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.312293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.312783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] PATH_INFO: `/v3/projects/1584deddc7ec429a9ee3a01e1bddd348/users/6c8e5d995c1e43499fea8ce20349a53c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.337427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1584deddc7ec429a9ee3a01e1bddd348, user_id=6c8e5d995c1e43499fea8ce20349a53c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.344310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.393965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 972/1944] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:19 2022] PUT /identity/v3/projects/1584deddc7ec429a9ee3a01e1bddd348/users/6c8e5d995c1e43499fea8ce20349a53c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:19.395302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.407869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58854f-636d-4d02-9328-e3a655d408b2 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.480270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.481022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.481416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.481942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.496703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed18c9a-f47e-4f19-8002-0fcb545d774b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.498233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:19.502600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.503263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.503622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.503722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.504077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.504903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.505509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.506795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072214e-077d-4000-9a6c-78fc98b5d805 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.517847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 973/1945] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:19.518343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 973/1946] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:19.522510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.533157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f96a6-3097-42f1-b6f1-924792e243b3 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.539324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.540766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.541241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.541583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] PATH_INFO: `/v3/projects/1584deddc7ec429a9ee3a01e1bddd348/users/6c8e5d995c1e43499fea8ce20349a53c/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.543975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1584deddc7ec429a9ee3a01e1bddd348, user_id=6c8e5d995c1e43499fea8ce20349a53c, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.546872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.559414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 974/1947] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:19 2022] PUT /identity/v3/projects/1584deddc7ec429a9ee3a01e1bddd348/users/6c8e5d995c1e43499fea8ce20349a53c/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:19.570852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.571028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.571327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.608245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] MFA Rules not processed for user `6c8e5d995c1e43499fea8ce20349a53c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:19.609651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.625414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:19.706545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 974/1948] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:19.718101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.720518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.814593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf268f-2371-46bb-89e3-1c7ddcd5df90 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.827628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.828558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.828933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.829912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.831918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.866455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:19.868170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:19.961049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.962061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:19.967964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09216-b124-4547-bc99-5e8a2f856b08 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:19.981344 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:19.982434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:19.982938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:19.983611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] PATH_INFO: `/v3/projects/e533fb243e194af8a3c536d9f1e3fcf5` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:19.986037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e533fb243e194af8a3c536d9f1e3fcf5)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:19.988737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 975/1949] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:20.004532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:20.124924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e533fb243e194af8a3c536d9f1e3fcf5', 'request_id': 'req-30874a3e-2994-4ab5-b96b-4baa630af5da'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.136261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e533fb243e194af8a3c536d9f1e3fcf5', 'request_id': 'req-30874a3e-2994-4ab5-b96b-4baa630af5da'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.160974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e533fb243e194af8a3c536d9f1e3fcf5', 'request_id': 'req-30874a3e-2994-4ab5-b96b-4baa630af5da'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.183316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] The token cache is being invalidate because project e533fb243e194af8a3c536d9f1e3fcf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:20.184265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.185124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.189795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 975/1950] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:19 2022] DELETE /identity/v3/projects/e533fb243e194af8a3c536d9f1e3fcf5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:20.190974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:20.211566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c0cc-ba7b-4104-ae99-d9de2aba2fe5 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:20.311575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:20.312237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:20.312521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:20.312812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] PATH_INFO: `/v3/users/398858821c58445c84d10d810b3fdaf7` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:20.314292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398858821c58445c84d10d810b3fdaf7)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:20.318002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:20.373120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:20.390453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398858821c58445c84d10d810b3fdaf7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.400896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398858821c58445c84d10d810b3fdaf7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.401257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398858821c58445c84d10d810b3fdaf7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.409737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398858821c58445c84d10d810b3fdaf7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.427024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f36ff75d-a713-4d91-a328-3b0edc597804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398858821c58445c84d10d810b3fdaf7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:20.435607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 976/1951] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:20 2022] DELETE /identity/v3/users/398858821c58445c84d10d810b3fdaf7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:20.849532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:20.851144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:20.864742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874a3e-2994-4ab5-b96b-4baa630af5da admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:20.914926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:20.938651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:20.939515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:20.939869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:20.940181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] PATH_INFO: `/v3/projects/ad573d778d06424cbbd4323064e1b49c` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:20.941496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad573d778d06424cbbd4323064e1b49c)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:20.943558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:20.995951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad573d778d06424cbbd4323064e1b49c', 'request_id': 'req-07bf44ed-51dd-42d9-b7d3-9149bd504b23'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:21.002096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad573d778d06424cbbd4323064e1b49c', 'request_id': 'req-07bf44ed-51dd-42d9-b7d3-9149bd504b23'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:21.009097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad573d778d06424cbbd4323064e1b49c', 'request_id': 'req-07bf44ed-51dd-42d9-b7d3-9149bd504b23'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:21.019954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] The token cache is being invalidate because project ad573d778d06424cbbd4323064e1b49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:21.020387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:21.021101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-07bf44ed-51dd-42d9-b7d3-9149bd504b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:21.022817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 976/1952] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:20 2022] DELETE /identity/v3/projects/ad573d778d06424cbbd4323064e1b49c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:21.028190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.029110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.029552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.050654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:21.051863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:21.115690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 977/1953] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:21.123524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.124444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.124961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.146242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:21.147518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:21.156196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 977/1954] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:21.160580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.170925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7718c-5d10-4367-af64-e151f65fc271 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.175517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.176131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.176416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.176690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.177381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:21.177682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.179289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.192710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 978/1955] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:21.196811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.206638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0f1f-8135-40a8-a1ae-8d94fe1777e7 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.211496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.212335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.212762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.213153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.213915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.215847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.244439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 978/1956] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:21.248493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.258773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860aa4-42d4-4c0c-b74d-2f9acef9a468 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.319150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.319774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.320056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.320328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.321007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.323015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.345906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 979/1957] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:21.350166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.362485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096cf9e-bca4-4422-8994-1a44dc171c13 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.367173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.367859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.368213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.369290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.370104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.371686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.382094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 979/1958] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:21.386452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.396774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a055ae-8ad2-40bc-807c-8e5d2d4f44eb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.402281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.402901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.403231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.403511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.404259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.405862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f8cf-bcb8-4f0f-83e0-6af5da898da1 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.417605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 980/1959] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:21.422012 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.432200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbc83-3e45-43c0-a96b-31921eaa6b3f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.436713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.437366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.437651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.437968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] PATH_INFO: `/v3/projects/f317676803d847c6ba281a65bfa31a5d/users/bd288311f89e4e849e1b37700dc0bb45/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.452812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f317676803d847c6ba281a65bfa31a5d, user_id=bd288311f89e4e849e1b37700dc0bb45, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.455481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.469207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 980/1960] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:21 2022] PUT /identity/v3/projects/f317676803d847c6ba281a65bfa31a5d/users/bd288311f89e4e849e1b37700dc0bb45/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:21.480314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.480622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.480907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.509783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] MFA Rules not processed for user `bd288311f89e4e849e1b37700dc0bb45`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:21.511078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:21.519483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:21.589124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 981/1961] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:21.594516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.720330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c26a-e206-4721-ae32-3c1914f68c42 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.726722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.727492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.728859 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.729389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.730936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.733440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:21.763306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:21.804892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 981/1962] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:21.806017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:21.824786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745d77f-7f68-4f7a-accb-3f0fe2fb71d6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:21.956897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:21.957537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:21.957836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:21.958150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:21.958820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:21.965777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.028637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.048341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 982/1963] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:21 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:22.062735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96841b39-f81d-4d5d-80fb-72418acc5501 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.076396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.078029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.078479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.079007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.079867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.082381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.105041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.117591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 982/1964] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:22.120833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182aee-1ed1-4978-bf4f-b096b20388de admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.135214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.136701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.136999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.137329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] PATH_INFO: `/v3/projects/808fef2f8cde4ea8af4080bf1eb92621/users/40a4ace612684c6baa2bf8e65883afc1/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.161044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808fef2f8cde4ea8af4080bf1eb92621, user_id=40a4ace612684c6baa2bf8e65883afc1, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.163897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.189400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.189569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 983/1965] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:22 2022] PUT /identity/v3/projects/808fef2f8cde4ea8af4080bf1eb92621/users/40a4ace612684c6baa2bf8e65883afc1/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:22.205861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.214435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:22.214632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1ff7-72e7-420f-b2f5-b27524922eb1 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.368487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c325f-f0fa-4465-b13e-2f5b6e6a2c42 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.374990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.376635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.376756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.377114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] PATH_INFO: `/v3/users/c46a602335df4739992d8fee06148f0a` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.378561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46a602335df4739992d8fee06148f0a)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.381710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.389095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.389845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.390295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.390652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.391441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.393130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.409321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:22.415104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 983/1966] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:22.418700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.441537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8fb67-1b21-417d-8afa-36870e869fcb admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.448253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.449092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.449438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.449729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] PATH_INFO: `/v3/projects/808fef2f8cde4ea8af4080bf1eb92621/users/40a4ace612684c6baa2bf8e65883afc1/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.451902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] RBAC: Authorizing `identity:create_grant(project_id=808fef2f8cde4ea8af4080bf1eb92621, user_id=40a4ace612684c6baa2bf8e65883afc1, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.454790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439a6f-7595-49ef-bc9b-af4ea42f666f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:22.467747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 984/1967] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:22 2022] PUT /identity/v3/projects/808fef2f8cde4ea8af4080bf1eb92621/users/40a4ace612684c6baa2bf8e65883afc1/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:22.480190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.480507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.480776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.484035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46a602335df4739992d8fee06148f0a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:22.497826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46a602335df4739992d8fee06148f0a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:22.498579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46a602335df4739992d8fee06148f0a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:22.514843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46a602335df4739992d8fee06148f0a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:22.526291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] MFA Rules not processed for user `40a4ace612684c6baa2bf8e65883afc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:22.529376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:22.535526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d994f71-ae39-43a4-80af-53a187ddb340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46a602335df4739992d8fee06148f0a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:22.544369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 984/1968] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:22 2022] DELETE /identity/v3/users/c46a602335df4739992d8fee06148f0a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:22.549143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.549434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.549715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.595612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:22.599844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:22.642172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 985/1969] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:22.651956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.655896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:22.707963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 985/1970] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:22.780138 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3a89-9398-44c5-8458-6407717a476f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.784035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:22.813510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:22.815564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:22.903679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.904341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.905277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.905565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.952744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592398-568b-4cdb-ac83-83605b306bdf None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:22.969678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:22.970599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:22.970946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:22.971226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:22.991733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:22.993047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:23.004937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:23.007786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:23.021603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 986/1971] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:23.049220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 986/1972] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:23.152732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:23.168406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bede76-c1bf-4be9-bc53-ceea7c462bbd service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:23.171923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:23.172562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:23.173034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:23.173318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:23.176054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:23.270979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:23.272516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:23.300695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 987/1973] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:23.789801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:23.792841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:23.814786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6945-7913-4578-accb-181f193b5414 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:23.820482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:23.821479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:23.821932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:23.822276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] PATH_INFO: `/v3/projects/42e446788a2e4b3eb20501b6b958d402` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:23.823489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e446788a2e4b3eb20501b6b958d402)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:23.825365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:23.860259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:23.873619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e446788a2e4b3eb20501b6b958d402', 'request_id': 'req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:23.884868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e446788a2e4b3eb20501b6b958d402', 'request_id': 'req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:23.891041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e446788a2e4b3eb20501b6b958d402', 'request_id': 'req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:23.904038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] The token cache is being invalidate because project 42e446788a2e4b3eb20501b6b958d402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:23.904332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:23.904980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:23.906528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 987/1974] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:23 2022] DELETE /identity/v3/projects/42e446788a2e4b3eb20501b6b958d402 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:23.910632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:23.922028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eb79-a3fd-49f8-9957-b46fb341d502 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:23.972818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:23.980437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:23.981120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:23.981407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:23.981694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] PATH_INFO: `/v3/users/4c1b417a37f04386a3e407d6297c3d7c` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:23.983075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1b417a37f04386a3e407d6297c3d7c)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:23.985270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:24.046532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1b417a37f04386a3e407d6297c3d7c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:24.047289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1b417a37f04386a3e407d6297c3d7c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:24.048027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1b417a37f04386a3e407d6297c3d7c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:24.060853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1b417a37f04386a3e407d6297c3d7c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:24.067996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1b417a37f04386a3e407d6297c3d7c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:24.081597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 988/1975] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:23 2022] DELETE /identity/v3/users/4c1b417a37f04386a3e407d6297c3d7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:24.928474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:24.930715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:24.934417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:24.937740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:25.001596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2fb3a-071a-4a52-b9ed-b4e554996ae9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.055038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae17cc-d0d6-404d-a058-8f8bf052cb82 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.064997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.065766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.066177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.066552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] PATH_INFO: `/v3/projects/b2ae2af4c47a4c41a958395258019f81` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.067877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ae2af4c47a4c41a958395258019f81)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.070204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.115824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.120432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.121455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.121957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.125584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:25.163136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ae2af4c47a4c41a958395258019f81', 'request_id': 'req-0d191326-808b-4cf2-b451-6a53ccd6cb80'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:25.174393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ae2af4c47a4c41a958395258019f81', 'request_id': 'req-0d191326-808b-4cf2-b451-6a53ccd6cb80'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:25.191372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ae2af4c47a4c41a958395258019f81', 'request_id': 'req-0d191326-808b-4cf2-b451-6a53ccd6cb80'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:25.212983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] The token cache is being invalidate because project b2ae2af4c47a4c41a958395258019f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:25.213303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:25.216485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0d191326-808b-4cf2-b451-6a53ccd6cb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:25.222707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 989/1976] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:24 2022] DELETE /identity/v3/projects/b2ae2af4c47a4c41a958395258019f81 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:25.227655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.228184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.228670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.248733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:25.276431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:25.278304 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:25.317053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.318546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c45-66f6-45c4-9d4e-6b595de51b84 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.347283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 988/1977] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:25.420359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 990/1978] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:25.431700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.431970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.432252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.460793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:25.462964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:25.474944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 989/1979] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:25.479904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.491028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745cb8-9ac7-4b74-bdd2-b41ba4cfa939 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.500623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.501369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.501755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.502173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.503172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:25.503662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.505468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.520003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 991/1980] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:25.524247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.537984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee15582-71fd-4c96-a838-52b2c5d05154 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.548079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.548980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.549685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.550138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.551517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.555187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.589918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:25.605331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 990/1981] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:25 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:25.609600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.626548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25b94-6c3b-4cf1-b0e3-c71f8cfec27e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.732789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.732789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.733150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.733150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.734025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.736020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.787093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.787804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 992/1982] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:25 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:25.810327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61ade-d1b2-4a0c-bd9e-cdec9e88c9cc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.815531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.816113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.816397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.816678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.817372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.819102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.849182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 991/1983] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:25.850462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.863077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ee2ef-18b7-4563-9c0f-277caad75d04 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.873128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.873870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.874227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.874582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.875469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.877131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c00214-468a-4d44-8d37-576756d3cd72 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.890004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 993/1984] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:25.894359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:25.905948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b776-22bf-42fa-96c0-eb9c76798fec admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:25.910593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:25.911261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.911547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.911826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] PATH_INFO: `/v3/projects/80392cda80984f8da014bf0401f80f90/users/bdd17c932551492c946ee509596f903c/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.928209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80392cda80984f8da014bf0401f80f90, user_id=bdd17c932551492c946ee509596f903c, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:25.930998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:25.944334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 992/1985] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:25 2022] PUT /identity/v3/projects/80392cda80984f8da014bf0401f80f90/users/bdd17c932551492c946ee509596f903c/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:25.955428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:25.955914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:25.956004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:25.986604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] MFA Rules not processed for user `bdd17c932551492c946ee509596f903c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:25.988749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:26.060650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:26.065093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 994/1986] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:26.069462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.136074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb437-53c7-41b3-aa8b-cd21646fe1b0 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.140733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.141349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.141632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.141931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.142607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.144498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.172738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 993/1987] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:26.176749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.188424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f915c5-17ef-49bc-88de-86777ea56e63 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.246676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.247307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.247595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.247875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.248691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.250669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.271821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 995/1988] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:26 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:26.276555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.286814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea430b-3945-413c-8737-f3b93a6318f3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.291685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.292284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.292594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.292866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.293577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.295233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.309081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 994/1989] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:26.310227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.320320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c58200-9d64-4648-ab15-75fa32adc95a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.325483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.326282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.326570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.326852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] PATH_INFO: `/v3/projects/7311ae8a8371462ea59a59ecee297379/users/4a8a3c514e44416b9ccad78923d31328/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.343055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7311ae8a8371462ea59a59ecee297379, user_id=4a8a3c514e44416b9ccad78923d31328, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.345802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.363714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 996/1990] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:26 2022] PUT /identity/v3/projects/7311ae8a8371462ea59a59ecee297379/users/4a8a3c514e44416b9ccad78923d31328/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:26.367798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.381663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ebc8-ba0b-4cb1-a08e-bd40e862fd07 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.528763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.529799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.530240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.530812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.531520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.533770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed2615-bf60-4029-ac70-d54b8629e3bd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.546694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 995/1991] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:26.550472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.563979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f6835-39af-48fc-a074-bd00f80a9af7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.570490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.572196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.572493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.572777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] PATH_INFO: `/v3/projects/7311ae8a8371462ea59a59ecee297379/users/4a8a3c514e44416b9ccad78923d31328/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.575441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7311ae8a8371462ea59a59ecee297379, user_id=4a8a3c514e44416b9ccad78923d31328, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.578358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.590462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 997/1992] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:26 2022] PUT /identity/v3/projects/7311ae8a8371462ea59a59ecee297379/users/4a8a3c514e44416b9ccad78923d31328/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:26.601747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.602073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.602391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.646269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] MFA Rules not processed for user `4a8a3c514e44416b9ccad78923d31328`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:26.647727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:26.678190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:26.753791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 996/1993] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:26.765616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:26.767904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:26.850741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b21c92-f6c0-47d8-8dd9-0c8f8ee8e65a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:26.857194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:26.857857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:26.858143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:26.858419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:26.868691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:26.870462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0d80d-6246-4ce6-8aff-e1aac89e749b service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:26.887567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 998/1994] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:28.228780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:28.299227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb267de-2aa9-4957-8920-a1799366457f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:28.305070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:28.305315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:28.305694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:28.306099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] PATH_INFO: `/v3/users/bdd17c932551492c946ee509596f903c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:28.308027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd17c932551492c946ee509596f903c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:28.309565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:28.361919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd17c932551492c946ee509596f903c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:28.374976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd17c932551492c946ee509596f903c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:28.375809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd17c932551492c946ee509596f903c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:28.389051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd17c932551492c946ee509596f903c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:28.402279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd17c932551492c946ee509596f903c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:28.409039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 997/1995] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:28 2022] DELETE /identity/v3/users/bdd17c932551492c946ee509596f903c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:28.413603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:28.414123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:28.414234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:28.433992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:28.435214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:28.485323 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:28.497600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 999/1996] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:28.507025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:28.509252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:28.563156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:28.584519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf44e-513e-469e-b1ab-88d4b6a01f65 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:28.590062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:28.590995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:28.591360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:28.591733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:28.612823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:28.614521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:28.629342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 998/1997] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:29.016239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:29.018090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:29.040443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dc3ff-c086-4c87-811f-7c84a9011174 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:29.049244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:29.049955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:29.050246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:29.050527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] PATH_INFO: `/v3/projects/80392cda80984f8da014bf0401f80f90` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:29.051959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80392cda80984f8da014bf0401f80f90)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:29.054033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:29.105498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80392cda80984f8da014bf0401f80f90', 'request_id': 'req-9b6a340b-745a-436a-af15-790f388ad32e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.112183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80392cda80984f8da014bf0401f80f90', 'request_id': 'req-9b6a340b-745a-436a-af15-790f388ad32e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.119886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80392cda80984f8da014bf0401f80f90', 'request_id': 'req-9b6a340b-745a-436a-af15-790f388ad32e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.132029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] The token cache is being invalidate because project 80392cda80984f8da014bf0401f80f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:29.132328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.135091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.136696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1000/1998] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:29 2022] DELETE /identity/v3/projects/80392cda80984f8da014bf0401f80f90 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:29.140618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:29.152078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8ef1-8661-475a-8a90-c8546b02220e service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:29.243585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:29.243585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:29.243585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:29.244296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] PATH_INFO: `/v3/users/4a8a3c514e44416b9ccad78923d31328` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:29.245226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8a3c514e44416b9ccad78923d31328)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:29.259639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:29.350415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8a3c514e44416b9ccad78923d31328'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.362458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8a3c514e44416b9ccad78923d31328'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.363095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8a3c514e44416b9ccad78923d31328'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.371725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8a3c514e44416b9ccad78923d31328'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.388783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f1448eb2-d324-48fb-8c2e-3d528086de86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8a3c514e44416b9ccad78923d31328'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.395821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 999/1999] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:29 2022] DELETE /identity/v3/users/4a8a3c514e44416b9ccad78923d31328 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:29.723117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:29.724758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:29.756678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a340b-745a-436a-af15-790f388ad32e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:29.827813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:29.829343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:29.829748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:29.830262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] PATH_INFO: `/v3/projects/7311ae8a8371462ea59a59ecee297379` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:29.831562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7311ae8a8371462ea59a59ecee297379)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:29.833617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:29.901939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7311ae8a8371462ea59a59ecee297379', 'request_id': 'req-b7995ca2-26af-4824-a975-ccbdee196df3'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.909414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7311ae8a8371462ea59a59ecee297379', 'request_id': 'req-b7995ca2-26af-4824-a975-ccbdee196df3'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.921408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7311ae8a8371462ea59a59ecee297379', 'request_id': 'req-b7995ca2-26af-4824-a975-ccbdee196df3'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.933595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] The token cache is being invalidate because project 7311ae8a8371462ea59a59ecee297379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:29.933912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.934542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b7995ca2-26af-4824-a975-ccbdee196df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:29.936253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1001/2000] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:29 2022] DELETE /identity/v3/projects/7311ae8a8371462ea59a59ecee297379 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:29.941334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:29.941650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:29.941963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:29.964831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:29.966494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.035135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:30.050656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1000/2001] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:30.058465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.058755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.059032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.078933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:30.080132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.089639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1002/2002] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:30.094287 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.104777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a563c5-8ca6-452d-aa3e-c9ecee28e97d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.109522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.110370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.110772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.111401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.112462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:30.113091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.115229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.128664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1001/2003] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:30.133229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.138819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:30.145455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc1a6b-dd12-45a6-89c8-368f21426581 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.152884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.153646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.154028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.154432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.155169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.157207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.190404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1003/2004] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:30.191833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.202282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3794-a0cc-4793-b2e6-719da2f1d375 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.270444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.271161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.271607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.271937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.272884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.276043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.301388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1002/2005] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:30 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:30.306743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.325744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ff5b-715c-4e52-9c5f-9146fcf97b1e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.334240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.334985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.335271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.335550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.336257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.338890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.354808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1004/2006] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:30.356160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.370143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4b78-9e5e-4a04-a9ac-3df534105223 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.375810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.376503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.376783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.377204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.379116 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.384047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6f59-0764-4590-833f-32a1b9838b5c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.420569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1003/2007] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:30.428453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.452318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff627d9-17e8-49fc-815a-5194b36499c8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.481638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.483594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.484815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.485282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] PATH_INFO: `/v3/projects/6c507f2dd8b7406eaf84178ebcf0d1fc/users/7ec8e27fb3354ee09bda48bb3c8ab11e/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.506549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c507f2dd8b7406eaf84178ebcf0d1fc, user_id=7ec8e27fb3354ee09bda48bb3c8ab11e, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.517052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.546168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1005/2008] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:30 2022] PUT /identity/v3/projects/6c507f2dd8b7406eaf84178ebcf0d1fc/users/7ec8e27fb3354ee09bda48bb3c8ab11e/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:30.564956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.565472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.565576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.636182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] MFA Rules not processed for user `7ec8e27fb3354ee09bda48bb3c8ab11e`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:30.637637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.759243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1004/2009] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:30.772062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.774365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.799057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.800781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.894212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:30.898296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5f3f-4bf4-41c7-b4f2-769f79d451de admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.900594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fd7f-6bd1-4693-bf2a-987d2203a9a2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.902907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.903547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.903836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.904121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.908611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.910811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:30.911094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:30.911363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] PATH_INFO: `/v3/users/bd288311f89e4e849e1b37700dc0bb45` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:30.912658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd288311f89e4e849e1b37700dc0bb45)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.915422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.915781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:30.919130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:30.929979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1006/2010] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:30.968759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:30.970935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:30.993264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3784-c293-482a-a943-68c48b9c7d11 service glance] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:30.998607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd288311f89e4e849e1b37700dc0bb45'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:30.998963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:30.999712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:31.000135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:31.000491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] PATH_INFO: `/v3/users/90cd20ee035348268d8bd6f643db50ac` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:31.002185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cd20ee035348268d8bd6f643db50ac)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:31.004726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:31.012700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd288311f89e4e849e1b37700dc0bb45'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.014020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd288311f89e4e849e1b37700dc0bb45'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.026717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd288311f89e4e849e1b37700dc0bb45'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.069160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8e30f821-3314-4278-8047-66ae28b386be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd288311f89e4e849e1b37700dc0bb45'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.086307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1005/2011] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:30 2022] DELETE /identity/v3/users/bd288311f89e4e849e1b37700dc0bb45 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:31.086578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cd20ee035348268d8bd6f643db50ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.088985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cd20ee035348268d8bd6f643db50ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.090442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cd20ee035348268d8bd6f643db50ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.091437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:31.091941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:31.092424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:31.117455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:31.120313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:31.121986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cd20ee035348268d8bd6f643db50ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.155342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fd504462-63f7-4b8c-8a35-61314348ceda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cd20ee035348268d8bd6f643db50ac'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:31.172285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:31.183196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1007/2012] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:30 2022] DELETE /identity/v3/users/90cd20ee035348268d8bd6f643db50ac => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:31.189999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:31.190553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:31.190892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:31.234427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:31.238377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:31.286531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1006/2013] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:31.293690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:31.299377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:31.334462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1008/2014] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:31.345502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:31.348261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:31.398260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90b2b-d640-4981-8cd8-1531c4f3470c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:31.437207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0df39a-0a04-46bb-808f-cf870a68c5f4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:31.440292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:31.443281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:31.444069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:31.444598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:31.445130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:31.459092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:31.460692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:31.473680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:31.474561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:31.474934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:31.475057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1009/2015] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:31.475342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:31.488970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:31.490835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:31.508049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1007/2016] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:32.091196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:32.095560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:32.112261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8320d-2e10-4484-8b5a-e822883add6e service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:32.123342 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:32.124003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:32.124340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:32.124626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] PATH_INFO: `/v3/projects/55987b496ddf4d448878c3615ac3e690` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:32.125939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55987b496ddf4d448878c3615ac3e690)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:32.127914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:32.195019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55987b496ddf4d448878c3615ac3e690', 'request_id': 'req-a592e537-135c-4ba6-9f13-7a38b9259949'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.211142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55987b496ddf4d448878c3615ac3e690', 'request_id': 'req-a592e537-135c-4ba6-9f13-7a38b9259949'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.221432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55987b496ddf4d448878c3615ac3e690', 'request_id': 'req-a592e537-135c-4ba6-9f13-7a38b9259949'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.237640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] The token cache is being invalidate because project 55987b496ddf4d448878c3615ac3e690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:32.238078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.238819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.244037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1010/2017] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:32 2022] DELETE /identity/v3/projects/55987b496ddf4d448878c3615ac3e690 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:32.245497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:32.257196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f152f-6671-4243-abc2-8adea2883683 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:32.263032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:32.264638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:32.322100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:32.361835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592e537-135c-4ba6-9f13-7a38b9259949 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:32.364782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:32.365839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:32.366195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:32.366410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] PATH_INFO: `/v3/users/6c8e5d995c1e43499fea8ce20349a53c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:32.366729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:32.367367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:32.367590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8e5d995c1e43499fea8ce20349a53c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:32.367694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:32.368002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] PATH_INFO: `/v3/projects/f317676803d847c6ba281a65bfa31a5d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:32.369864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f317676803d847c6ba281a65bfa31a5d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:32.370125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:32.371786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:32.435528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f317676803d847c6ba281a65bfa31a5d', 'request_id': 'req-6a3375fc-cedd-4961-a102-5f570552055b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.438213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8e5d995c1e43499fea8ce20349a53c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.446538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f317676803d847c6ba281a65bfa31a5d', 'request_id': 'req-6a3375fc-cedd-4961-a102-5f570552055b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.449707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8e5d995c1e43499fea8ce20349a53c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.450799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8e5d995c1e43499fea8ce20349a53c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.455197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f317676803d847c6ba281a65bfa31a5d', 'request_id': 'req-6a3375fc-cedd-4961-a102-5f570552055b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.461097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8e5d995c1e43499fea8ce20349a53c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.468607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] The token cache is being invalidate because project f317676803d847c6ba281a65bfa31a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:32.468945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.469888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.472833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1011/2018] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:32 2022] DELETE /identity/v3/projects/f317676803d847c6ba281a65bfa31a5d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:32.477848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:32.480796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8e5d995c1e43499fea8ce20349a53c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.481235 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:32.487111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1008/2019] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:32 2022] DELETE /identity/v3/users/6c8e5d995c1e43499fea8ce20349a53c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:32.548320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3375fc-cedd-4961-a102-5f570552055b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:32.606733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:32.607389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:32.607671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:32.607944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] PATH_INFO: `/v3/users/40a4ace612684c6baa2bf8e65883afc1` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:32.609117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a4ace612684c6baa2bf8e65883afc1)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:32.611334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:32.615895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:32.677345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a4ace612684c6baa2bf8e65883afc1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.678093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a4ace612684c6baa2bf8e65883afc1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.678672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a4ace612684c6baa2bf8e65883afc1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.702799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a4ace612684c6baa2bf8e65883afc1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.713786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-86a47ff8-b2aa-4768-8d5e-cea678f8fa83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a4ace612684c6baa2bf8e65883afc1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:32.752914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1012/2020] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:32 2022] DELETE /identity/v3/users/40a4ace612684c6baa2bf8e65883afc1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:32.803072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:32.804869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:32.850054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe412-7e06-44ce-948e-aa22236f4497 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:32.949140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:32.963418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:32.964557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:32.965259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:32.965684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] PATH_INFO: `/v3/projects/1584deddc7ec429a9ee3a01e1bddd348` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:32.967064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1584deddc7ec429a9ee3a01e1bddd348)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:32.969258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.039189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1584deddc7ec429a9ee3a01e1bddd348', 'request_id': 'req-ed534266-9af2-4412-abac-95b257ef86eb'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.057336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1584deddc7ec429a9ee3a01e1bddd348', 'request_id': 'req-ed534266-9af2-4412-abac-95b257ef86eb'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.068477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1584deddc7ec429a9ee3a01e1bddd348', 'request_id': 'req-ed534266-9af2-4412-abac-95b257ef86eb'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.085222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] The token cache is being invalidate because project 1584deddc7ec429a9ee3a01e1bddd348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:33.085524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.086227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.098854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1009/2021] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:32 2022] DELETE /identity/v3/projects/1584deddc7ec429a9ee3a01e1bddd348 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:33.099753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cf93-4b4b-4cbb-973e-113b37e2e31b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.100255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cf93-4b4b-4cbb-973e-113b37e2e31b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.100507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cf93-4b4b-4cbb-973e-113b37e2e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.132308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5959cf93-4b4b-4cbb-973e-113b37e2e31b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:33.134687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5959cf93-4b4b-4cbb-973e-113b37e2e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.168396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.169893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.250318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1013/2022] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:33.252269 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.252562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.252845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.273877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:33.275641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.283457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534266-9af2-4412-abac-95b257ef86eb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.285663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1014/2023] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:33.290681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.293024 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.294172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.294997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.295424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] PATH_INFO: `/v3/projects/808fef2f8cde4ea8af4080bf1eb92621` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.297521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808fef2f8cde4ea8af4080bf1eb92621)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.300352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.300647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0d4d-d6d3-46df-b5c9-74572729acca None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.306345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.307280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.307572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.307851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.310991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:33.310991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.312532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.335043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1015/2024] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:33.335980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.352136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f279cb-c0cb-42e0-a348-a7a2864b9ed8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.357985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.358646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.358931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.359204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.359873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.362060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.375687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808fef2f8cde4ea8af4080bf1eb92621', 'request_id': 'req-62550670-d825-4cee-b479-0c15e6e541a1'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.387547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808fef2f8cde4ea8af4080bf1eb92621', 'request_id': 'req-62550670-d825-4cee-b479-0c15e6e541a1'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.395304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808fef2f8cde4ea8af4080bf1eb92621', 'request_id': 'req-62550670-d825-4cee-b479-0c15e6e541a1'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.417864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] The token cache is being invalidate because project 808fef2f8cde4ea8af4080bf1eb92621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:33.417864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.417864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-62550670-d825-4cee-b479-0c15e6e541a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:33.417864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1010/2025] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:33 2022] DELETE /identity/v3/projects/808fef2f8cde4ea8af4080bf1eb92621 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:33.420605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649bb6-d88a-4378-aef6-6000faf0a8a3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.420897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649bb6-d88a-4378-aef6-6000faf0a8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.421265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649bb6-d88a-4378-aef6-6000faf0a8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.439212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1016/2026] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:33.443762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.447488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.455457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0f649bb6-d88a-4378-aef6-6000faf0a8a3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:33.456145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0f649bb6-d88a-4378-aef6-6000faf0a8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.466707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:33.517820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:33.585616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821fdee-4880-4980-8fe6-8506d0e994b5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.592194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.592911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.593209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.593964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.594648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.596821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.611710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1011/2027] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:33.613694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.614108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.614755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.627288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1017/2028] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:33.631149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.646806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967212d-d2d1-4305-bdd5-0716ee0def1e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.666004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.666781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.667073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.667360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.668079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.672194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.674382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:33.675865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.689612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1012/2029] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:33.690691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.716034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1018/2030] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:33.718318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.725149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099dc13-534b-4f78-a4dc-00816ea3a451 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.749651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.750446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.750733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.751384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.751744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:33.753743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.758172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.759881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c863a-d8aa-47e8-b82c-6644d4d16ab9 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.769400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.770259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.770676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.770849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.771549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.773766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.801878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1013/2031] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:33.807535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.814878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1019/2032] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:33.816043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.825706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705faf-d35c-44a7-a8ab-f3be876a9fb2 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.829890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32053-2676-4a17-9368-d6cc7273993d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.835658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.836285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.836873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.837746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.850119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.850610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.850610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.850610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.850807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.850807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] PATH_INFO: `/v3/projects/53b3b15b3b834c8487c47524ddb72102/users/58eb54485cc1411b9eefecdd0dba764d/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.873238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b3b15b3b834c8487c47524ddb72102, user_id=58eb54485cc1411b9eefecdd0dba764d, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.876083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70624f94-349c-450e-b2e7-e8fd41afd022 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:33.891192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1014/2033] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:33.892398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:33.895411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1020/2034] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:33 2022] PUT /identity/v3/projects/53b3b15b3b834c8487c47524ddb72102/users/58eb54485cc1411b9eefecdd0dba764d/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:33.913341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.914120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.914448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.952193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] MFA Rules not processed for user `58eb54485cc1411b9eefecdd0dba764d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:33.953314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:33.973185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb694465-dc00-4c66-9e04-eaced33daf0e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:33.981380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:33.982593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:33.982772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:33.983081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:33.983807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:33.986047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.026034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1015/2035] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:34.027904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.048736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0612-58bf-4c21-8a27-2ad8e3baa44f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.054052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.054812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.055152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.056063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.056779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.059249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.066185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1021/2036] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:34.080055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.082495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1016/2037] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:34.083608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:34.084289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.105999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c954a-b31c-4f0e-a690-847f4aeb5484 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.116527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.117355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.117703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.118214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.119365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.121161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.136639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1017/2038] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:34.141524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.159722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f16c-af52-4a74-93b8-f6b94868c1a4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.168830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.169482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.169772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.170091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.170953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045431b-b404-4338-bac4-4e2c7fb5ca74 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.176959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.178049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.178555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.179113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] PATH_INFO: `/v3/projects/7f2542152431422da6eda116f54676ab/users/3c91e7fa83ec422eb7c2647ade0097dc/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.183731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.186221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf2d8-f34f-429c-965a-a32352ba12e5 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.199776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1022/2039] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:34.208940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2542152431422da6eda116f54676ab, user_id=3c91e7fa83ec422eb7c2647ade0097dc, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.211974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.236415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1018/2040] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:34 2022] PUT /identity/v3/projects/7f2542152431422da6eda116f54676ab/users/3c91e7fa83ec422eb7c2647ade0097dc/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:34.247600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.247917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.248203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.297121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] MFA Rules not processed for user `3c91e7fa83ec422eb7c2647ade0097dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:34.300216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:34.306466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:34.408591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1023/2041] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:34.413177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.435790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:34.528215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55783-b307-4aaa-88db-ebb03f55fbe3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.541945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.542588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.542864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.543142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.543861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.548926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.618476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1019/2042] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:34 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:34.622946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.640355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c0fac-c220-47c8-aa19-dcb54a851205 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.749507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.750791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.751097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.751386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.753576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.756278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.784556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1024/2043] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:34 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:34.788317 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.802098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74503ad-fd47-426f-bf25-8a06fb6ae8d5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.807355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.807503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.807783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.808056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.808762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.810441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.821521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1020/2044] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:34.826108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.840677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca5cc5-9a7b-4f46-ac47-3b676435bfba admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.846095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.847310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.847664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.848010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] PATH_INFO: `/v3/projects/fd837bd066364895890e772f91d2dd84/users/977492e0fddb47f8a1ea2291d1cd7c32/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.872660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd837bd066364895890e772f91d2dd84, user_id=977492e0fddb47f8a1ea2291d1cd7c32, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.875654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.893018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1025/2045] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:34 2022] PUT /identity/v3/projects/fd837bd066364895890e772f91d2dd84/users/977492e0fddb47f8a1ea2291d1cd7c32/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:34.896962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:34.908780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b09d-d738-4789-bf69-c43993967712 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:34.981781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:34.982487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:34.982888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:34.983307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:34.984029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:34.985733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1660-e9cc-41a2-b248-e8f851271a9e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:34.996902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1021/2046] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:35.000964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.011737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51df4-c9a2-481a-9ddb-1fbd03adf5f4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.016491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.017159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.017447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.017725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] PATH_INFO: `/v3/projects/fd837bd066364895890e772f91d2dd84/users/977492e0fddb47f8a1ea2291d1cd7c32/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.019723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd837bd066364895890e772f91d2dd84, user_id=977492e0fddb47f8a1ea2291d1cd7c32, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.022401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.034987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1026/2047] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:34 2022] PUT /identity/v3/projects/fd837bd066364895890e772f91d2dd84/users/977492e0fddb47f8a1ea2291d1cd7c32/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:35.047165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.047551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.047918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.053499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.055177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.076501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] MFA Rules not processed for user `977492e0fddb47f8a1ea2291d1cd7c32`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:35.077698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.123838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878217eb-1c16-465f-9091-7a3b3fb318ce admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.130672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.131320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.131603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.131882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] PATH_INFO: `/v3/users/1f8f1e74781042628455d6b85c603a96` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.133162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8f1e74781042628455d6b85c603a96)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.135293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.136981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:35.153014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1022/2048] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:35.164273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.178175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:35.213655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8f1e74781042628455d6b85c603a96'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.215364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8f1e74781042628455d6b85c603a96'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.216246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8f1e74781042628455d6b85c603a96'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.244192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21e6bf-f7d1-4847-a5bf-666b036eab45 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.250953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.251706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.252214 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.252551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.254971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8f1e74781042628455d6b85c603a96'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.256477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.270002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-531297d5-0ed1-4dba-8cf4-8b3bc3ca8c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8f1e74781042628455d6b85c603a96'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.284864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.286521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.291749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1027/2049] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:35 2022] DELETE /identity/v3/users/1f8f1e74781042628455d6b85c603a96 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:35.297237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.297643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.297978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.299632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1023/2050] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:35.322628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:35.324015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.330599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.332386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.365277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b977-bf76-4c7f-9d6d-63319972da6e service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.436930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1028/2051] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:35.446900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.448881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.458739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.459398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.459684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.459963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] PATH_INFO: `/v3/users/3c91e7fa83ec422eb7c2647ade0097dc` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.461140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c91e7fa83ec422eb7c2647ade0097dc)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.463123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.517313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c91e7fa83ec422eb7c2647ade0097dc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.518969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aa32d-cd75-43ab-ab84-3193102f0192 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.522650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.523270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.523551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.523826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.525986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c91e7fa83ec422eb7c2647ade0097dc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.526967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c91e7fa83ec422eb7c2647ade0097dc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.534717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.535008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c91e7fa83ec422eb7c2647ade0097dc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.536160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f546e4e-317e-40cf-b92f-1000c61b36f1 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.546463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1029/2052] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:35.548344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c91e7fa83ec422eb7c2647ade0097dc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:35.554452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1024/2053] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:35 2022] DELETE /identity/v3/users/3c91e7fa83ec422eb7c2647ade0097dc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:35.559751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.560046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.560331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.579453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:35.581646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.601453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:35.647806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1030/2054] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:35.658572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:35.660117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:35.700049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:35.733385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f33698-4387-457d-bdde-3b97be2dda1a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:35.739900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:35.740747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:35.741092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:35.741435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:35.756008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:35.757560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85ead-fa4b-40cc-b2b4-01d5c149490e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:35.768970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1025/2055] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:36.018919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.020645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.034823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c1d9-76c5-42d4-b65d-c0c7ee83d55a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.040276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.041392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.041392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.041615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] PATH_INFO: `/v3/projects/cf35271c00fe482f8e32f637f920c2d0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.044721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf35271c00fe482f8e32f637f920c2d0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.046857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.100211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf35271c00fe482f8e32f637f920c2d0', 'request_id': 'req-6e1f5264-c912-41cc-8f19-ce748f4bece6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.107551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf35271c00fe482f8e32f637f920c2d0', 'request_id': 'req-6e1f5264-c912-41cc-8f19-ce748f4bece6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.116237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf35271c00fe482f8e32f637f920c2d0', 'request_id': 'req-6e1f5264-c912-41cc-8f19-ce748f4bece6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.127965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] The token cache is being invalidate because project cf35271c00fe482f8e32f637f920c2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:36.128289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.128927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-6e1f5264-c912-41cc-8f19-ce748f4bece6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.130492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1031/2056] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:36 2022] DELETE /identity/v3/projects/cf35271c00fe482f8e32f637f920c2d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:36.135668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.136037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.136389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.177577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:36.178908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.255094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1026/2057] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:36.263508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.264007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.264097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.285174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:36.286574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.294682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.296390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1032/2058] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:36.297056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.300951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.312464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e182f-01d2-4662-9b01-809ee8be8762 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.316757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9244592-4cca-4d35-82cb-43bcedc8186a None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.318194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.318866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.319152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.319433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.320146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:36.320462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.322361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.323544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.324192 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.324495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.324897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] PATH_INFO: `/v3/projects/7f2542152431422da6eda116f54676ab` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.326095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2542152431422da6eda116f54676ab)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.328397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.340728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1033/2059] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:36.342041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.353070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5c64-1f65-43a5-8cae-17b215f4b868 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.357876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.358495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.358778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.359085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.359779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.362125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.387777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2542152431422da6eda116f54676ab', 'request_id': 'req-e616bf0c-85b8-40f8-8329-14743912ac6e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.396578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2542152431422da6eda116f54676ab', 'request_id': 'req-e616bf0c-85b8-40f8-8329-14743912ac6e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.400690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1034/2060] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:36.405897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.409759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2542152431422da6eda116f54676ab', 'request_id': 'req-e616bf0c-85b8-40f8-8329-14743912ac6e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.423578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] The token cache is being invalidate because project 7f2542152431422da6eda116f54676ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:36.423877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.424560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.426407 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1027/2061] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:36 2022] DELETE /identity/v3/projects/7f2542152431422da6eda116f54676ab => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:36.430157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.431568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.485241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7bf43-ccce-4987-b5c2-c86f18b2b0e5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.490519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.491156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.491442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.492354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.492516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.494680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.504663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:36.507659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bf0c-85b8-40f8-8329-14743912ac6e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.518326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1035/2062] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:36.519731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.520394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.520762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.521042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] PATH_INFO: `/v3/users/977492e0fddb47f8a1ea2291d1cd7c32` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.522053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.522831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977492e0fddb47f8a1ea2291d1cd7c32)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.524906 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.525028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.527775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:36.542007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e49fa-4735-4cd2-bd1c-d59b29b64af8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.546640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.547263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.547707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.547995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.548698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.550330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.561333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1036/2063] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:36.565045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.577846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649320d-87c4-4d57-b112-96983bfe359a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.581296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.581956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.582243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.582519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.583240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.584903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.592279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977492e0fddb47f8a1ea2291d1cd7c32'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.596910 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1037/2064] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:36.600755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.603504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977492e0fddb47f8a1ea2291d1cd7c32'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.604300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977492e0fddb47f8a1ea2291d1cd7c32'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.612488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edf53e-b2f8-468a-99e4-27aea4c23358 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.618891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977492e0fddb47f8a1ea2291d1cd7c32'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.634429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9fc32b27-19f1-4942-9f85-3380c03526c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977492e0fddb47f8a1ea2291d1cd7c32'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:36.636915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.637605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.637920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.638263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] PATH_INFO: `/v3/projects/2550b5786dd946aab37088a319f98b43/users/b052e8e6684f4186b0c4fe37799fc9f1/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.642896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1028/2065] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:36 2022] DELETE /identity/v3/users/977492e0fddb47f8a1ea2291d1cd7c32 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:36.660508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2550b5786dd946aab37088a319f98b43, user_id=b052e8e6684f4186b0c4fe37799fc9f1, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.664189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.702146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1038/2066] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:36 2022] PUT /identity/v3/projects/2550b5786dd946aab37088a319f98b43/users/b052e8e6684f4186b0c4fe37799fc9f1/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:36.704350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.704643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.705043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.744670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] MFA Rules not processed for user `b052e8e6684f4186b0c4fe37799fc9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:36.746165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.871601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1029/2067] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:36.872365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.874207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.958927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b6963-6b3e-4050-a2b9-2ec08af1ab17 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.965359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.966641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.967098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.967488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.968265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:36.970360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:36.971091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:36.972539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:36.990042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c9b44-525d-4eb7-88ec-d92c200d1dd6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:36.995929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:36.996718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:36.996963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:36.997246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] PATH_INFO: `/v3/users/58eb54485cc1411b9eefecdd0dba764d` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:36.998820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58eb54485cc1411b9eefecdd0dba764d)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.000832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.008202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1039/2068] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:36 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:37.012501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.093989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58eb54485cc1411b9eefecdd0dba764d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.102225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af097ccb-8f08-45da-933d-a0638cb6fa92 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.104978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58eb54485cc1411b9eefecdd0dba764d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.106063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58eb54485cc1411b9eefecdd0dba764d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.108812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.109443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.109764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.110267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.111487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.113883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912503c1-31b6-4b73-a881-5d3532cbbc4d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.114536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58eb54485cc1411b9eefecdd0dba764d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.115709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:37.131153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58eb54485cc1411b9eefecdd0dba764d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.137736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1030/2069] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:36 2022] DELETE /identity/v3/users/58eb54485cc1411b9eefecdd0dba764d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:37.138779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.140169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.141850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1040/2070] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:37.143094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.143393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.143675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.162991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:37.164194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.181335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:37.209107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3831-4074-447b-8013-b9d532ec099f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.215242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.216357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.216837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.217291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] PATH_INFO: `/v3/projects/fd837bd066364895890e772f91d2dd84` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.218943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd837bd066364895890e772f91d2dd84)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.221008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.238640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1041/2071] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:37.243631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.245391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.259974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f650e-f655-4235-90bf-9f059d723174 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.271241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.271892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.272161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.272446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.273163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.276133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.288183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1042/2072] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:37.289216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.293088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.298453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd837bd066364895890e772f91d2dd84', 'request_id': 'req-568dca60-421e-49c2-80be-395e36741e79'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.310031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd837bd066364895890e772f91d2dd84', 'request_id': 'req-568dca60-421e-49c2-80be-395e36741e79'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.319110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd837bd066364895890e772f91d2dd84', 'request_id': 'req-568dca60-421e-49c2-80be-395e36741e79'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.332245 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] The token cache is being invalidate because project fd837bd066364895890e772f91d2dd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:37.332546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.333509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:37.335846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1031/2073] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:37 2022] DELETE /identity/v3/projects/fd837bd066364895890e772f91d2dd84 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:37.337209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.338906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.375943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290d17-e328-4a2f-84c5-a07d7025d253 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.416764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dca60-421e-49c2-80be-395e36741e79 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.421773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.422445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.422730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.423012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.423713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.425302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf777247-c7ad-48d9-8b6f-30685350a785 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.436321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.436964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.437244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1032/2074] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:37.437622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.438075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.439952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.441797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a4c6-b3f8-4fbf-8715-b4ae3a9063c9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.442107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a4c6-b3f8-4fbf-8715-b4ae3a9063c9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.442429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a4c6-b3f8-4fbf-8715-b4ae3a9063c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.457254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.458811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.464288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:37.474468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7b43a4c6-b3f8-4fbf-8715-b4ae3a9063c9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:37.478271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7b43a4c6-b3f8-4fbf-8715-b4ae3a9063c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.479826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1043/2075] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:37.480770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.490957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1033/2076] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:37.491529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1085-3c69-4f93-b4c1-eca535bf6faa service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.500029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.500318 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.500637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.502832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.503624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.504264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.504674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] PATH_INFO: `/v3/projects/ada447056dd54dcb98bd1184421ce36d/users/a605e0e2d1804f24bf37b289413ddc6e/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.521026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada447056dd54dcb98bd1184421ce36d, user_id=a605e0e2d1804f24bf37b289413ddc6e, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.522324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:37.523559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.523842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cd329-d33a-4114-8746-f13ebaddac70 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.532789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1034/2077] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:37.537366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.556328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1044/2078] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:37 2022] PUT /identity/v3/projects/ada447056dd54dcb98bd1184421ce36d/users/a605e0e2d1804f24bf37b289413ddc6e/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:37.559618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.560169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.560592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.567893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214fbb2-4278-44c0-84ea-8f6711d2a386 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.598036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] MFA Rules not processed for user `a605e0e2d1804f24bf37b289413ddc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:37.599937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.639354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:37.645314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.646305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.646767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.647053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.648241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:37.649028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.650543 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.663358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1035/2079] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:37.668098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.678400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27321322-ba20-4df9-aa56-a3a2f53acf54 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.679937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1045/2080] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:37.684456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.685023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.685980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.686358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.686775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.687580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.690199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.698887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc7f9-bd23-4f1c-885a-ab34dc81d86e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.713385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.714107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.715051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.715573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.716792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.719446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.731094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1036/2081] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:37.735276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.757073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1046/2082] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:37.763130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.810892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fd4a4-ab82-4a4c-a1ae-eece3228f5a3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.860336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa4dc-8d7e-499e-a4b2-33bc38320421 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.869346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.871007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.871639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.873305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.874296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.876315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.895893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.896726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.897137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.897509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.898334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.900702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.904123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1047/2083] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:37.904123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.907767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:37.931594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1037/2084] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:37 2022] POST /identity/v3/users => generated 305 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:37.932667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.942969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:37.944127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab41551-9aa0-42be-9ed6-a4ace1deeb24 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.957606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760df2-acb4-40b7-a6d7-80020a4cb087 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:37.959013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.959800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.960147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.960512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] PATH_INFO: `/v3/projects/53b3b15b3b834c8487c47524ddb72102` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.963923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:37.964488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:37.964837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:37.964952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b3b15b3b834c8487c47524ddb72102)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.965240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:37.966036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:37.968027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.968159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:37.984246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1038/2085] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:37.984246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:37.998566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163c1d8-4906-457a-bfaf-a1f486b61347 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.028772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.031027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.031703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.032731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.035343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.039329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.056023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1039/2086] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:38.057379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.068046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b3b15b3b834c8487c47524ddb72102', 'request_id': 'req-b53cdf69-0f92-4713-8322-2e8e9718560b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:38.076713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047ba14-1981-478b-a2ad-a3cc7b523abb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.081923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b3b15b3b834c8487c47524ddb72102', 'request_id': 'req-b53cdf69-0f92-4713-8322-2e8e9718560b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:38.098171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b3b15b3b834c8487c47524ddb72102', 'request_id': 'req-b53cdf69-0f92-4713-8322-2e8e9718560b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:38.118642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] The token cache is being invalidate because project 53b3b15b3b834c8487c47524ddb72102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:38.118960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:38.119767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:38.121457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1048/2087] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:37 2022] DELETE /identity/v3/projects/53b3b15b3b834c8487c47524ddb72102 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:38.126036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.127373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.163824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:38.195441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.198058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.199012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.199652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] PATH_INFO: `/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e/users/a145500cd1e84432887cb6bea7e35e91/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.204230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdf69-0f92-4713-8322-2e8e9718560b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.209599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.210365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.210659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.210981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.211796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.213920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d846ee0-9474-49c4-9a8b-077f78853f66 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.226005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1049/2088] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:38.232129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.232746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.232746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.241203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373d0e4b7ffa4956961b2b93ca6e016e, user_id=a145500cd1e84432887cb6bea7e35e91, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.246289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.273191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:38.274854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.277626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1040/2089] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:38 2022] PUT /identity/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e/users/a145500cd1e84432887cb6bea7e35e91/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:38.278696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.356388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1050/2090] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:38.356769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.358331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.364131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb417-cb07-44da-80bd-caf889f6eb88 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.370904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.371582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.371862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.372138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] PATH_INFO: `/v3/projects/235ee883fc6143a28b5300795b639bcb/users/b5f85180d7d143fc88c7056a529d0d46/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.372255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396cba0-1831-4ce5-a647-86b613390739 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.377628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.378699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.378699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.378886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.379600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.381997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b50a25-5aac-45fb-b6fc-42fa236e5285 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.389288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] RBAC: Authorizing `identity:create_grant(project_id=235ee883fc6143a28b5300795b639bcb, user_id=b5f85180d7d143fc88c7056a529d0d46, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.392848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.399473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1051/2091] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:38.404428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1073c-2442-41ee-baf4-237b01a131da None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.404717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1073c-2442-41ee-baf4-237b01a131da None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.404995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1073c-2442-41ee-baf4-237b01a131da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.408392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1041/2092] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:38 2022] PUT /identity/v3/projects/235ee883fc6143a28b5300795b639bcb/users/b5f85180d7d143fc88c7056a529d0d46/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:38.408995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.435465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a1e1073c-2442-41ee-baf4-237b01a131da None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:38.436775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a1e1073c-2442-41ee-baf4-237b01a131da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.470031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:38.494750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdf523-c83d-4168-ab60-2ca657ec997a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.506634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.507425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.507804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.508124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] PATH_INFO: `/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e/users/a145500cd1e84432887cb6bea7e35e91/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.516999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373d0e4b7ffa4956961b2b93ca6e016e, user_id=a145500cd1e84432887cb6bea7e35e91, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.519921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5edbc-0eba-42ca-b668-c0bab4253880 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.534563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1042/2093] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:38 2022] PUT /identity/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e/users/a145500cd1e84432887cb6bea7e35e91/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:38.535941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.536230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.536507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.571284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1052/2094] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:38.572626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.572912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.573229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.586355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] MFA Rules not processed for user `b5f85180d7d143fc88c7056a529d0d46`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:38.589004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.616059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] MFA Rules not processed for user `a145500cd1e84432887cb6bea7e35e91`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:38.617296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.670833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:38.671045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1043/2095] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:38.672869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.712554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1053/2096] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:38.713539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.765216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9485f2-ee57-4568-b4bb-7dc08d360945 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.770168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.770916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.771197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.771472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.772177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:38.772827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.774820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.791908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1044/2097] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:38.791908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.793902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.813224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6449f-aabb-4858-b6fb-3fd92cdd2d8d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.818482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.819122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.819404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.819682 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.820357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.824330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.858597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1054/2098] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:38.859860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:38.876874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfeea5-bf5f-49b1-a79b-128fa80d60a5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.898265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:38.932569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2fe0e-ca49-4e33-ba44-c9351a0a0372 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:38.937482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.938139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.938419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.938845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.939629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:38.940029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:38.940988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:38.941345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:38.941552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:38.941686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:38.944078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:38.972789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1055/2099] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:38.973552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.020918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.022289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.037445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:39.037630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1045/2100] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:39.038395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.059797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e807-693e-4792-b3cd-1a7fd11f1f85 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.065087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410720-1b50-478c-8387-42b55b0dc5fa admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.066692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.067420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.067768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.068164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.068901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.071359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.071557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.072221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.072508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.072794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.073502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.076060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.107322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1046/2101] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:39 2022] POST /identity/v3/users => generated 296 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:39.108687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.109934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1056/2102] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:38 2022] POST /identity/v3/users => generated 311 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:39.114926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.120810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f9f3-4a10-441b-8d79-40d18a9bfc35 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.136596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e7f5-b14c-4fc6-a273-a9a8664b18f5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.139070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.140984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.141412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.141735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.143782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.144416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.144933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.145471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.145752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.146539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.147367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.148691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.166828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1057/2103] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:39.171242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.181772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1047/2104] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:39.183502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9327e-a270-4c0c-bcce-d6e8f22aa885 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.184547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.188625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.189798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.190303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.190585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] PATH_INFO: `/v3/projects/140caabd24984f56be0fda30be1490b0/users/ac9366ae42da4a928dc54429c7587139/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.196163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0098-4798-4c74-a98d-7270c840a3cc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.203190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.203930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.204270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.204554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.205571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.207505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.208037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] RBAC: Authorizing `identity:create_grant(project_id=140caabd24984f56be0fda30be1490b0, user_id=ac9366ae42da4a928dc54429c7587139, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.211705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.234034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1048/2105] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:39.234034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.238778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1058/2106] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:39 2022] PUT /identity/v3/projects/140caabd24984f56be0fda30be1490b0/users/ac9366ae42da4a928dc54429c7587139/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:39.244398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.245475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc04f-0bc2-4284-b4d1-289624442951 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.334080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78447-894b-45f3-aaaf-489b260c827f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.339894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.340662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.340814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.341101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.341896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.343710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.354778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1059/2107] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:39.361011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.365545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.366256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.366605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.366790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] PATH_INFO: `/v3/projects/14a6a2eea8544ce3a01ecd911c486999/users/a9b10434b6bf42868e6dc6de16e30029/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.378955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb4446-5b7e-4abd-b44f-e2d20c16325b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.388397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.389402 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.390069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.390191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a6a2eea8544ce3a01ecd911c486999, user_id=a9b10434b6bf42868e6dc6de16e30029, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.390467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] PATH_INFO: `/v3/projects/140caabd24984f56be0fda30be1490b0/users/ac9366ae42da4a928dc54429c7587139/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.392611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2a7e7-f820-42e1-b1d9-76a7a2c0f8ba admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.393550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] RBAC: Authorizing `identity:create_grant(project_id=140caabd24984f56be0fda30be1490b0, user_id=ac9366ae42da4a928dc54429c7587139, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.397724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984219d7-a897-4de3-b7cb-72a031cc591a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.409587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1049/2108] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:39 2022] PUT /identity/v3/projects/14a6a2eea8544ce3a01ecd911c486999/users/a9b10434b6bf42868e6dc6de16e30029/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:39.425010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1060/2109] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:39 2022] PUT /identity/v3/projects/140caabd24984f56be0fda30be1490b0/users/ac9366ae42da4a928dc54429c7587139/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:39.427430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.427964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.428499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.439882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.441542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.442000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.468858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] MFA Rules not processed for user `a9b10434b6bf42868e6dc6de16e30029`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:39.470635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:39.475339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] MFA Rules not processed for user `ac9366ae42da4a928dc54429c7587139`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:39.478669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:39.481773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:39.583898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1061/2110] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:39.598190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.617374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:39.625243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1050/2111] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:39.637305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.638732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:39.677472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad5573-0ce9-4da6-b21e-3c37df59116c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.681795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.682451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.682748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.683033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.694048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.696542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.702408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369388f9-e9a8-475a-b7b4-148943591293 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.706992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.707686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.708032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.708372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:39.709474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1062/2112] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:39.719042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:39.720588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:39.734869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1051/2113] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:39.922140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:39.931010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac845d-d5ad-486b-910d-a54c37874bce service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:39.936905 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:39.937928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:39.938224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:39.939777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:40.017741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:40.019468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:40.036446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1063/2114] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:40.768018 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:40.777171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25e40-66e2-4f5a-a872-1c8e2ecc2d62 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:40.781016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:40.781644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:40.781968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:40.782248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:40.784165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:40.857633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:40.859177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:40.870873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1052/2115] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:41.589062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:41.598409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fe83-667d-47d7-90c5-dcf4f9b38b2b service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:41.602339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:41.603011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:41.603324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:41.603585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:41.666061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:41.667426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:41.678356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1064/2116] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:45.904586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:45.947773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:45.971589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:45.987179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186665-6c7d-47a0-9cf7-4074d2e82394 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:45.992021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:45.993408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:45.993694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:45.994016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] PATH_INFO: `/v3/users/b5f85180d7d143fc88c7056a529d0d46` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:45.995485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f85180d7d143fc88c7056a529d0d46)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:45.997406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.000576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:46.016931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87bca-aa2d-425f-b963-ffaf167ab31d service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.021644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:46.022379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.022681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.022962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] PATH_INFO: `/v3/users/b052e8e6684f4186b0c4fe37799fc9f1` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.024417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b052e8e6684f4186b0c4fe37799fc9f1)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:46.026529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.050154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f85180d7d143fc88c7056a529d0d46'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.058908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f85180d7d143fc88c7056a529d0d46'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.059658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f85180d7d143fc88c7056a529d0d46'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.070992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f85180d7d143fc88c7056a529d0d46'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.086904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0870f403-e38f-4c15-ac26-0b0e2eff3a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f85180d7d143fc88c7056a529d0d46'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.087919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b052e8e6684f4186b0c4fe37799fc9f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.089345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b052e8e6684f4186b0c4fe37799fc9f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.090569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b052e8e6684f4186b0c4fe37799fc9f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.094430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1053/2117] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:45 2022] DELETE /identity/v3/users/b5f85180d7d143fc88c7056a529d0d46 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:46.099173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.099588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.099880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.107967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b052e8e6684f4186b0c4fe37799fc9f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.115320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-221d559b-ca12-4379-9964-ea73745b8652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b052e8e6684f4186b0c4fe37799fc9f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.120383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:46.121957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.129380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1065/2118] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:45 2022] DELETE /identity/v3/users/b052e8e6684f4186b0c4fe37799fc9f1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:46.133985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.134281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.134562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.153753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:46.155007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.185487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1054/2119] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:46.194969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.197036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.215549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1066/2120] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:46.225189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.226594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.256330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5077c-f844-47a2-9ba0-712ccb4fbda9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.277674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:46.285190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250d7fe-cc67-433c-a0d7-417f8c49e686 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.289001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:46.290432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.290773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.291051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.301557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:46.303397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.309743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:46.310391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.310674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.310949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.313472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1067/2121] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:46.320512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:46.322352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.332928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1055/2122] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:46.730285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.731711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.746404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d78f8-55bf-4337-a686-3748c585cf30 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.755676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.757390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.766014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:46.766770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.767127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.767506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] PATH_INFO: `/v3/projects/2550b5786dd946aab37088a319f98b43` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.768851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2550b5786dd946aab37088a319f98b43)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:46.771170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.774585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:46.779660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeccc97-19c6-4609-8334-9384ba2459f6 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.793650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:46.794663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:46.794948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:46.795228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] PATH_INFO: `/v3/projects/235ee883fc6143a28b5300795b639bcb` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:46.797131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=235ee883fc6143a28b5300795b639bcb)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:46.799704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:46.847445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2550b5786dd946aab37088a319f98b43', 'request_id': 'req-163f51c1-c0f2-4919-a7f0-d60f399e8229'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.854900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2550b5786dd946aab37088a319f98b43', 'request_id': 'req-163f51c1-c0f2-4919-a7f0-d60f399e8229'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.859903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235ee883fc6143a28b5300795b639bcb', 'request_id': 'req-13276913-7e73-4639-9f9c-244344d9da9a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.864389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2550b5786dd946aab37088a319f98b43', 'request_id': 'req-163f51c1-c0f2-4919-a7f0-d60f399e8229'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.868532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235ee883fc6143a28b5300795b639bcb', 'request_id': 'req-13276913-7e73-4639-9f9c-244344d9da9a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.875321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235ee883fc6143a28b5300795b639bcb', 'request_id': 'req-13276913-7e73-4639-9f9c-244344d9da9a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.878955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] The token cache is being invalidate because project 2550b5786dd946aab37088a319f98b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:46.879379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.880077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.881697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1068/2123] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:46 2022] DELETE /identity/v3/projects/2550b5786dd946aab37088a319f98b43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:46.886106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.887429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.899951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] The token cache is being invalidate because project 235ee883fc6143a28b5300795b639bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:46.900242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.900925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:46.902566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1056/2124] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:46 2022] DELETE /identity/v3/projects/235ee883fc6143a28b5300795b639bcb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:46.906351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:46.907659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:46.958712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f51c1-c0f2-4919-a7f0-d60f399e8229 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:46.988666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276913-7e73-4639-9f9c-244344d9da9a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:47.000528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.000528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.000528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.000876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] PATH_INFO: `/v3/users/ac9366ae42da4a928dc54429c7587139` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.002111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9366ae42da4a928dc54429c7587139)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.004235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.031646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.032577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.032952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.033300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] PATH_INFO: `/v3/users/a605e0e2d1804f24bf37b289413ddc6e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.034773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a605e0e2d1804f24bf37b289413ddc6e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.036885 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.084726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9366ae42da4a928dc54429c7587139'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.090722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:47.095268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9366ae42da4a928dc54429c7587139'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.095419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:47.096515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9366ae42da4a928dc54429c7587139'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.104597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a605e0e2d1804f24bf37b289413ddc6e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.105972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a605e0e2d1804f24bf37b289413ddc6e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.107206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a605e0e2d1804f24bf37b289413ddc6e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.107399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9366ae42da4a928dc54429c7587139'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.124268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9366ae42da4a928dc54429c7587139'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.129781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a605e0e2d1804f24bf37b289413ddc6e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.131734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1057/2125] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:46 2022] DELETE /identity/v3/users/ac9366ae42da4a928dc54429c7587139 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:47.141241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a605e0e2d1804f24bf37b289413ddc6e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.157409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1069/2126] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:46 2022] DELETE /identity/v3/users/a605e0e2d1804f24bf37b289413ddc6e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:47.425142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:47.427229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.457886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:47.459739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.517114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bd821-e465-4c26-82ba-826a85bd7b7c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:47.534882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1a99-2f69-4324-b7cb-018b247ce186 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:47.541204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.541891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.542168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.542444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] PATH_INFO: `/v3/projects/ada447056dd54dcb98bd1184421ce36d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.543805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada447056dd54dcb98bd1184421ce36d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.545773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.596508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.597153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.597423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.597696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] PATH_INFO: `/v3/projects/140caabd24984f56be0fda30be1490b0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.598905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] RBAC: Authorizing `identity:delete_project(project_id=140caabd24984f56be0fda30be1490b0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.600850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.613551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada447056dd54dcb98bd1184421ce36d', 'request_id': 'req-c3a44f19-9339-42da-82e5-a6f3757ece9e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.621646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada447056dd54dcb98bd1184421ce36d', 'request_id': 'req-c3a44f19-9339-42da-82e5-a6f3757ece9e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.630385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada447056dd54dcb98bd1184421ce36d', 'request_id': 'req-c3a44f19-9339-42da-82e5-a6f3757ece9e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.643761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] The token cache is being invalidate because project ada447056dd54dcb98bd1184421ce36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:47.644054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.644907 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.647071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1070/2127] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:47 2022] DELETE /identity/v3/projects/ada447056dd54dcb98bd1184421ce36d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:47.651296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:47.653167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.663818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140caabd24984f56be0fda30be1490b0', 'request_id': 'req-25011850-6051-4b4d-9d71-c24873a6381d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.676639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140caabd24984f56be0fda30be1490b0', 'request_id': 'req-25011850-6051-4b4d-9d71-c24873a6381d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.686352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140caabd24984f56be0fda30be1490b0', 'request_id': 'req-25011850-6051-4b4d-9d71-c24873a6381d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.703496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] The token cache is being invalidate because project 140caabd24984f56be0fda30be1490b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:47.703825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.704481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-25011850-6051-4b4d-9d71-c24873a6381d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.706302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1058/2128] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:47 2022] DELETE /identity/v3/projects/140caabd24984f56be0fda30be1490b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:47.711794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a56f6-208c-4601-9277-4387a20309c2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.712231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a56f6-208c-4601-9277-4387a20309c2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.712634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a56f6-208c-4601-9277-4387a20309c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.715555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:47.728529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:47.737377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d94a56f6-208c-4601-9277-4387a20309c2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:47.738995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d94a56f6-208c-4601-9277-4387a20309c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.739118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44f19-9339-42da-82e5-a6f3757ece9e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:47.810288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.810944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.811227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.811507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] PATH_INFO: `/v3/users/a145500cd1e84432887cb6bea7e35e91` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.812806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a145500cd1e84432887cb6bea7e35e91)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.815595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.829598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1059/2129] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:47.838644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.838963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.839310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.862025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:47.863236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.871861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1060/2130] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:47.876158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:47.880530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a145500cd1e84432887cb6bea7e35e91'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.881722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a145500cd1e84432887cb6bea7e35e91'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.882533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a145500cd1e84432887cb6bea7e35e91'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.889401 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56853713-7a27-4266-add3-8b62b76639b7 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:47.894888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:47.896034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:47.896395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:47.896662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:47.898140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:47.898447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:47.900885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:47.907577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a145500cd1e84432887cb6bea7e35e91'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.918905 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1061/2131] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:47.921355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:47.922123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a145500cd1e84432887cb6bea7e35e91'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:47.923580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:47.939801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1071/2132] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:47 2022] DELETE /identity/v3/users/a145500cd1e84432887cb6bea7e35e91 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:47.940159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b271-b989-4c01-b14d-20eabaf341ce admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.009689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.010293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.010579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.010854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.011532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.014016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.047675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1062/2133] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:47 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:48.051674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.063535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48b70-0a6a-4ff3-aee8-ba2e3a9ce6c6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.131678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.132439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.132789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.133902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.134684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.136864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.174513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1072/2134] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:48.177367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.199815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df9cb-b950-4412-a1e8-6703f8a49c6f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.210405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.211594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.211899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.212194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.213515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.215311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.230923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1063/2135] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:48.235779 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.246803 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:48.256026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444b014-0b82-4be1-9a3d-2e9726fc0f55 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.266751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.267683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.268441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.268873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.269296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.269652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:48.270259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.272394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.294993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1073/2136] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:48.296731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.299900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402d6b6-ec39-4676-b515-b42c896ddf1e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.306035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.307635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.308433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.308881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] PATH_INFO: `/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.310265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373d0e4b7ffa4956961b2b93ca6e016e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.310819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebf82-e59b-4727-aec8-919a65ed27cd admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.312447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.317568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.318802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.319102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.319377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] PATH_INFO: `/v3/projects/449c803f3e7b4c7dac28a98bf04ee8c1/users/e782d4dab06c46839fe9ddcdc18848d7/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.336936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449c803f3e7b4c7dac28a98bf04ee8c1, user_id=e782d4dab06c46839fe9ddcdc18848d7, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.339718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833ed09-2985-4d5f-a161-16b3f56dd985 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.354451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1074/2137] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:48 2022] PUT /identity/v3/projects/449c803f3e7b4c7dac28a98bf04ee8c1/users/e782d4dab06c46839fe9ddcdc18848d7/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:48.366703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.367136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.368324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.376616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373d0e4b7ffa4956961b2b93ca6e016e', 'request_id': 'req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:48.389932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373d0e4b7ffa4956961b2b93ca6e016e', 'request_id': 'req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:48.391990 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:48.404868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373d0e4b7ffa4956961b2b93ca6e016e', 'request_id': 'req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:48.411485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] MFA Rules not processed for user `e782d4dab06c46839fe9ddcdc18848d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:48.412802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:48.420133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] The token cache is being invalidate because project 373d0e4b7ffa4956961b2b93ca6e016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:48.420553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:48.421243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-66a8c30c-dc20-40a8-a8db-4b4d37e1f921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:48.422880 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1064/2138] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:48 2022] DELETE /identity/v3/projects/373d0e4b7ffa4956961b2b93ca6e016e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:48.427576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052167-131b-4868-b1ab-eddc6d3d08ed None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.427863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052167-131b-4868-b1ab-eddc6d3d08ed None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.428153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052167-131b-4868-b1ab-eddc6d3d08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.451124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-28052167-131b-4868-b1ab-eddc6d3d08ed None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:48.452601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-28052167-131b-4868-b1ab-eddc6d3d08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:48.487723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1075/2139] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:48.492895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.494835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:48.517891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1065/2140] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:48.524409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.524705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.524978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.545793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:48.547135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:48.556847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1066/2141] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:48.560064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90de17-9f2f-4c0e-bd5e-1be7e073be10 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.561014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.564776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.565468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.565843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.566238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.566948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.568876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.570347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652479-c9d5-42e1-8dca-5e45786a8025 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.575210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.575813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.576096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.576371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.577067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:48.577371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.579724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.593849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1067/2142] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:48.597083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.602800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1076/2143] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:48.606643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.608119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738fb00-3df0-461e-b08c-15323cc9365a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.652977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:48.668678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.669298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.669579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.669881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.670556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.671311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fb93-ad64-494b-82c2-43e46fd85a40 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.672459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.676329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.676950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.677599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.677933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.678603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.680738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.705590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1068/2144] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:48.705837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1077/2145] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:48.707064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.707210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.718006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee212b-0fb8-46b9-b063-7f53982f6596 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.760851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:48.774819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0528cd-3be3-4393-8321-bb6ce5829df3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.776709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.777616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.777616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.777915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.778646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.780234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.780622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.781321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.781584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.781892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.782583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.784488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.791155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1078/2146] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:48.795361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.807095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda713-c01b-4238-b519-032413e31872 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.812424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1069/2147] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:48.812564 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.813000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.813367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.813464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.813652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] PATH_INFO: `/v3/projects/979bfbee9a634ee7aec49663d457a458/users/0a9698a9634d4fdc87316d8e72dfa69a/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.825640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46ef7-37fe-447c-84df-4354702a7e27 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.830219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979bfbee9a634ee7aec49663d457a458, user_id=0a9698a9634d4fdc87316d8e72dfa69a, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.830595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.831246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.831528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.831802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.832555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.832953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.834233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.849641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1070/2148] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:48.849838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1079/2149] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:48 2022] PUT /identity/v3/projects/979bfbee9a634ee7aec49663d457a458/users/0a9698a9634d4fdc87316d8e72dfa69a/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:48.851112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.852541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.861835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86ca6-1afb-43d1-b5e0-a0b2543c864c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.917443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c4ef-3722-497d-a043-c970420ddba6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.922164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.922707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.923166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.923166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.923368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.923449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.923590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.923882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.924025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.924567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.925567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.926171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.935960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1080/2150] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:48.936132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1071/2151] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:48.939843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.939960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:48.950255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472b27-61b8-41f1-a3ab-c3157c5dee12 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.950400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878c776-1988-477f-9b40-42f9da8ce3d5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:48.954909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.955050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:48.955558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.955663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.955841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.955966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.956127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] PATH_INFO: `/v3/projects/12e0c8c80ac645b5bcb5a5b3cd6a44b6/users/7268ae80780a4d09967a82f3297dd8ed/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.956272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] PATH_INFO: `/v3/projects/979bfbee9a634ee7aec49663d457a458/users/0a9698a9634d4fdc87316d8e72dfa69a/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.958157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979bfbee9a634ee7aec49663d457a458, user_id=0a9698a9634d4fdc87316d8e72dfa69a, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.960812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460a645-889a-48ee-9133-443e16b95572 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.972534 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e0c8c80ac645b5bcb5a5b3cd6a44b6, user_id=7268ae80780a4d09967a82f3297dd8ed, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:48.974595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1081/2152] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:48 2022] PUT /identity/v3/projects/979bfbee9a634ee7aec49663d457a458/users/0a9698a9634d4fdc87316d8e72dfa69a/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:48.983915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46547af-d679-496e-b52c-e45ae21368aa admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:48.995531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1072/2153] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:48 2022] PUT /identity/v3/projects/12e0c8c80ac645b5bcb5a5b3cd6a44b6/users/7268ae80780a4d09967a82f3297dd8ed/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:48.995838 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.996127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.996407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:48.996957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:48.997309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:48.997600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:49.022028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:49.023657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:49.046349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] MFA Rules not processed for user `0a9698a9634d4fdc87316d8e72dfa69a`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:49.048093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:49.069375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:49.118677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1073/2154] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:49.130011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:49.131430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:49.137194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1082/2155] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:49.147873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:49.149590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:49.181780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:49.199265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8bb9f-176c-4fa5-9126-5bb2f30731aa None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:49.203148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:49.203770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:49.204048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:49.204315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:49.215483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102266d4-878f-4797-8892-8345fe16ae79 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:49.218694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:49.220134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa980-62e0-430a-ae42-ebdbb315d483 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:49.223511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:49.224227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:49.224515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:49.224794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:49.230544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1074/2156] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:49.314414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:49.318266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:49.339058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1083/2157] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:50.126087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:50.126626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:50.126841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:50.163350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] MFA Rules not processed for user `7268ae80780a4d09967a82f3297dd8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:50.164879 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:50.262737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1075/2158] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:50.273689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:50.275302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:50.287969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641fd1-b68f-4e88-93e6-23a9e811df0a service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:50.292770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:50.293397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:50.293679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:50.293986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:50.303098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:50.304531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624a7e-bcb6-41e0-880b-b144d4627574 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:50.314707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1084/2159] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:50.456384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:50.458413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:50.475913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397b9c9-1326-4f35-81a1-637e3d89c202 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:50.486879 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:50.487547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:50.487860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:50.488143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] PATH_INFO: `/v3/users/a9b10434b6bf42868e6dc6de16e30029` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:50.490533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b10434b6bf42868e6dc6de16e30029)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:50.493496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:50.584261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b10434b6bf42868e6dc6de16e30029'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:50.598569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b10434b6bf42868e6dc6de16e30029'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:50.601209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b10434b6bf42868e6dc6de16e30029'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:50.615891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b10434b6bf42868e6dc6de16e30029'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:50.632286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b10434b6bf42868e6dc6de16e30029'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:50.659499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:50.662223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:50.662521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:50.670776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1076/2160] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:50 2022] DELETE /identity/v3/users/a9b10434b6bf42868e6dc6de16e30029 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:50.686637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:50.687908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:50.768764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:50.787000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1085/2161] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:50.797600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:50.799598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:50.882164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:50.891237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c3c0-88e9-4878-8e28-409f72e897b6 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:50.897107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:50.897888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:50.898266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:50.899162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:50.910186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:50.911699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee60744-dc15-4753-b578-eaf119ac95ea service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:50.935659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1077/2162] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:51.270677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:51.272166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:51.286306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968f5c1-d3cd-4ba1-a7d4-88e833a4af65 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:51.294528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:51.295491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:51.296027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:51.296505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] PATH_INFO: `/v3/projects/14a6a2eea8544ce3a01ecd911c486999` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:51.298113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a6a2eea8544ce3a01ecd911c486999)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:51.300568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:51.359908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a6a2eea8544ce3a01ecd911c486999', 'request_id': 'req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:51.368922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a6a2eea8544ce3a01ecd911c486999', 'request_id': 'req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:51.379808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a6a2eea8544ce3a01ecd911c486999', 'request_id': 'req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:51.393583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] The token cache is being invalidate because project 14a6a2eea8544ce3a01ecd911c486999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:51.394006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:51.394715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:51.396636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1086/2163] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:51 2022] DELETE /identity/v3/projects/14a6a2eea8544ce3a01ecd911c486999 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:51.782838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d1f8d-7634-4691-a31d-14a7ee917a5e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:51.783396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d1f8d-7634-4691-a31d-14a7ee917a5e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:51.783396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d1f8d-7634-4691-a31d-14a7ee917a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:51.803025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-2b6d1f8d-7634-4691-a31d-14a7ee917a5e None None] MFA Rules not processed for user `7268ae80780a4d09967a82f3297dd8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:51.804232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2b6d1f8d-7634-4691-a31d-14a7ee917a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:51.863784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1078/2164] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:52.091416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:52.092896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:52.185126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde81cf-b280-47e0-89ad-bc5ac04c87f1 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:52.190303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:52.190972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:52.191256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:52.191536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] PATH_INFO: `/v3/users/e782d4dab06c46839fe9ddcdc18848d7` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:52.192902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e782d4dab06c46839fe9ddcdc18848d7)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:52.194926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:52.269895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e782d4dab06c46839fe9ddcdc18848d7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:52.270560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e782d4dab06c46839fe9ddcdc18848d7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:52.271169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e782d4dab06c46839fe9ddcdc18848d7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:52.286108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e782d4dab06c46839fe9ddcdc18848d7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:52.294044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e782d4dab06c46839fe9ddcdc18848d7'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:52.303380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:52.310775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1087/2165] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:52 2022] DELETE /identity/v3/users/e782d4dab06c46839fe9ddcdc18848d7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:52.315540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:52.315873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:52.316386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:52.338368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:52.339584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:52.403344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1079/2166] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:52.412949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:52.414979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:52.478448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2d9c-ee69-4347-b290-da5c20fb28cc admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:52.482389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:52.483168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:52.483612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:52.483991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:52.496394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:52.497909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:52.509650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1088/2167] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:52.877127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:52.879121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:52.898072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a7057-6abc-4d2e-9522-9b6bf2de5c66 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:52.918995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:52.919987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:52.920419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:52.920895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] PATH_INFO: `/v3/projects/449c803f3e7b4c7dac28a98bf04ee8c1` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:52.922773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=449c803f3e7b4c7dac28a98bf04ee8c1)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:52.925542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:53.003933 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449c803f3e7b4c7dac28a98bf04ee8c1', 'request_id': 'req-b0438a25-1cd3-4945-86b3-748c69f16d0b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.017927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449c803f3e7b4c7dac28a98bf04ee8c1', 'request_id': 'req-b0438a25-1cd3-4945-86b3-748c69f16d0b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.024702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449c803f3e7b4c7dac28a98bf04ee8c1', 'request_id': 'req-b0438a25-1cd3-4945-86b3-748c69f16d0b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.040848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] The token cache is being invalidate because project 449c803f3e7b4c7dac28a98bf04ee8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:53.041278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.042232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.044570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1080/2168] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:52 2022] DELETE /identity/v3/projects/449c803f3e7b4c7dac28a98bf04ee8c1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:53.053173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:53.073294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d158-220a-42b9-9796-134cdcd30456 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:53.162614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:53.162847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:53.163234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:53.163614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] PATH_INFO: `/v3/users/0a9698a9634d4fdc87316d8e72dfa69a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:53.165683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9698a9634d4fdc87316d8e72dfa69a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:53.167266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:53.231799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9698a9634d4fdc87316d8e72dfa69a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.232871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9698a9634d4fdc87316d8e72dfa69a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.233992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9698a9634d4fdc87316d8e72dfa69a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.259545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9698a9634d4fdc87316d8e72dfa69a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.267970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e5bf0f82-659e-451e-a18f-5cb032c0e07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9698a9634d4fdc87316d8e72dfa69a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.300308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1089/2169] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:53 2022] DELETE /identity/v3/users/0a9698a9634d4fdc87316d8e72dfa69a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:53.796648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:53.798072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:53.823831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438a25-1cd3-4945-86b3-748c69f16d0b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:53.840969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:53.895924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:53.896582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:53.897029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:53.897462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] PATH_INFO: `/v3/projects/979bfbee9a634ee7aec49663d457a458` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:53.899631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=979bfbee9a634ee7aec49663d457a458)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:53.901545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:53.949010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ed6b-8240-46f6-94e2-b8b03e31c5aa None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:53.949570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ed6b-8240-46f6-94e2-b8b03e31c5aa None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:53.950061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ed6b-8240-46f6-94e2-b8b03e31c5aa None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:53.951835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1090/2170] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:52:53.964630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979bfbee9a634ee7aec49663d457a458', 'request_id': 'req-a7b23808-f0fb-4134-be0f-91915d551f1f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.975244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979bfbee9a634ee7aec49663d457a458', 'request_id': 'req-a7b23808-f0fb-4134-be0f-91915d551f1f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.985904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:53.986641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:53.987039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979bfbee9a634ee7aec49663d457a458', 'request_id': 'req-a7b23808-f0fb-4134-be0f-91915d551f1f'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:53.987197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:53.999958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] The token cache is being invalidate because project 979bfbee9a634ee7aec49663d457a458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:54.000252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.001007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a7b23808-f0fb-4134-be0f-91915d551f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.003305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1081/2171] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:53 2022] DELETE /identity/v3/projects/979bfbee9a634ee7aec49663d457a458 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:54.008124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.008655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.009080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.015237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] MFA Rules not processed for user `3fbdfe23df8c4200ac0d437c075942d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.016707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.036102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.037533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.040389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:54.096750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1091/2172] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:54.098217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.099594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.104968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1082/2173] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:54.109511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.111034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.116013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19bb2-0f15-4624-8007-906f2aa3d48b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.121369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.122043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.122326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.122787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] PATH_INFO: `/v3/users/6370c0b81bb347c8bf3de4d98d80060e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.123973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6370c0b81bb347c8bf3de4d98d80060e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.125959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.126637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce52e5-bffc-4fc8-b866-394931c42b8d None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.132926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.133532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.133835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.134126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.144949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.146580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd585-9760-4034-ba17-b733b5930fba service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.160680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1083/2174] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:54.162333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.162595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.162870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.184083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6370c0b81bb347c8bf3de4d98d80060e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.184773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6370c0b81bb347c8bf3de4d98d80060e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.185883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.185972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6370c0b81bb347c8bf3de4d98d80060e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.187250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.202674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6370c0b81bb347c8bf3de4d98d80060e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.207557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1084/2175] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:54.208616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.218240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4672c-6008-4ad3-9cbc-5b33cfb7c5b2 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.218453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6370c0b81bb347c8bf3de4d98d80060e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.223274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.224101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.224545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.224921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.225838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:54.226219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.228818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.234065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1092/2176] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:54 2022] DELETE /identity/v3/users/6370c0b81bb347c8bf3de4d98d80060e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:54.241285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1085/2177] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:54.247430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.315934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63bae-16a0-499f-b97a-0d4e65d0c655 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.320792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.321427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.321712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.322024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.322700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.324612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.360015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1093/2178] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:54.364764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.384540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf440435-741a-4c00-95af-ae2369a616dc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.397253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:54.447855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.449656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.457084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.457697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.458003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.458269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.459725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.462284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.467948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:54.497722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1086/2179] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:54.498651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.510004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624268fb-2c84-4fac-a831-23fa21af8239 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.515058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.515564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.515951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.516239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.517013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.518745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.531340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1087/2180] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:54.535773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.548327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d904-3ec2-4dfc-aced-6cb2759d7b9e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.552359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba8d9-2aa8-406f-bcf7-c90707957093 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.553324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.553981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.554266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.554570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.555595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.557723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.557952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.558745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.559207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.560023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] PATH_INFO: `/v3/projects/a3a641241dbf4cbb8d42344528daf50a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.562182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a641241dbf4cbb8d42344528daf50a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.564524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.573547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1088/2181] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:54.574834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.590376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff40d-c263-4ab1-97ee-9182465e23f3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.600760 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.615430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.615430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.615674 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] PATH_INFO: `/v3/projects/64bd06d514a349cebcf664be96c000b2/users/a20d5ba9a44e44d79ae8ec1622911bd4/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.639009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a641241dbf4cbb8d42344528daf50a', 'request_id': 'req-8faaaf36-5e25-47f3-9c21-0ede9b465ace'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.646160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a641241dbf4cbb8d42344528daf50a', 'request_id': 'req-8faaaf36-5e25-47f3-9c21-0ede9b465ace'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.655590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bd06d514a349cebcf664be96c000b2, user_id=a20d5ba9a44e44d79ae8ec1622911bd4, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.658730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164dadf-12b1-4383-a945-c2ca89763760 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.668871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a641241dbf4cbb8d42344528daf50a', 'request_id': 'req-8faaaf36-5e25-47f3-9c21-0ede9b465ace'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.675877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1089/2182] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:54 2022] PUT /identity/v3/projects/64bd06d514a349cebcf664be96c000b2/users/a20d5ba9a44e44d79ae8ec1622911bd4/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:54.682726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] The token cache is being invalidate because project a3a641241dbf4cbb8d42344528daf50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:54.683159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.684078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8faaaf36-5e25-47f3-9c21-0ede9b465ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:54.686238 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1094/2183] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:54 2022] DELETE /identity/v3/projects/a3a641241dbf4cbb8d42344528daf50a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:54.687598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0c83-c32b-4122-b913-deff7651c041 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.687893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0c83-c32b-4122-b913-deff7651c041 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.688170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0c83-c32b-4122-b913-deff7651c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.690824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.691222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.691610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.716441 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.717767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.718450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-391c0c83-c32b-4122-b913-deff7651c041 None None] MFA Rules not processed for user `a20d5ba9a44e44d79ae8ec1622911bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.719838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-391c0c83-c32b-4122-b913-deff7651c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.792500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1090/2184] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:54.793484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1095/2185] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:54.801251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.801467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.801765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.802075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.802940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.831472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42c50a-d4d1-4b19-81dd-a43246b22844 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.832781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:54.834350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:54.837236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.837919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.838212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.838493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.842045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.844007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.844996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1091/2186] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:54.851125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.862480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034403-80a4-4387-b099-e9f4b633de6f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.868144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.868901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.869282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.869612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.871868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:54.871868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.873919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.880243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1096/2187] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:54.884983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.889064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1092/2188] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:52:54.893702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:54.906285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319bb1-1e44-4163-81a8-e85c8d41f5ef admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.914274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:54.937166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:54.964170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e75d-7000-48dc-8ed7-261f6d335e56 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:54.971662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.972509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.972801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.972904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:54.973085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.973663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:54.973959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.974061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:54.974372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:54.975106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:54.976699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:54.977209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.003380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1097/2189] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:55.007329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.015773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1093/2190] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:54 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:55.019860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.021729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f93a4-d05d-40fc-8d49-a3c70b50d90a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.100428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.100825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e4c49-a5ef-49fa-881d-34259399c5ae admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.101086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.101413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.102359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.103067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.104688 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.106590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.107210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.107494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.107770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.108432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.110417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.118976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1098/2191] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.120023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.132628 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d6a7b-2500-46c4-a096-a0776fb67e69 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.137662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.138320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.138763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1094/2192] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:55.141543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.141894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.142675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.143198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.144722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.156552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1099/2193] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.158255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661f164-7601-4776-822b-df1cf3afb856 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.160977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.165276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.166106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.166490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.166868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.167710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.169541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.172485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238f91-2305-4772-9f0e-32938ac028c4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.177704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.178406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.178691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.178965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] PATH_INFO: `/v3/projects/cbcb8456764b41da9cdbc91f13acc50d/users/0c540725cc7b49f9a710e0eba9942349/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.189890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1095/2194] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:55.191369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.197954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcb8456764b41da9cdbc91f13acc50d, user_id=0c540725cc7b49f9a710e0eba9942349, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.201320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade67a28-fdc7-4235-ad7a-2045f3f3036b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.203070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c58c2-0b4c-445f-8283-d9fe6d124c51 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.208991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.210103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.210412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.210670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.212467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.214087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.219077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1100/2195] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:55 2022] PUT /identity/v3/projects/cbcb8456764b41da9cdbc91f13acc50d/users/0c540725cc7b49f9a710e0eba9942349/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:55.229656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.230006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.230263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.232623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1096/2196] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.233887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.255371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b91b-9587-4a8a-a67f-2af1e9ca5e73 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.268856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] MFA Rules not processed for user `0c540725cc7b49f9a710e0eba9942349`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:55.270102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:55.328891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.329787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.330112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.330425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] PATH_INFO: `/v3/projects/897c75070b4d4bd2b8eed5ee5e5ce417/users/4ea61f775e944d18bcd28293efb0e4c4/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.344656 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1101/2197] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:55.349341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.354767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897c75070b4d4bd2b8eed5ee5e5ce417, user_id=4ea61f775e944d18bcd28293efb0e4c4, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.356609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:55.357706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598c830-5ddf-4118-a10c-98f1faa6ae04 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.365112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e980-2c8e-47b0-a398-0c6467fae8bb None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.371952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.372581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.372911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.373365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.374353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.374472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1097/2198] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:55 2022] PUT /identity/v3/projects/897c75070b4d4bd2b8eed5ee5e5ce417/users/4ea61f775e944d18bcd28293efb0e4c4/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:55.378866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.393065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.393065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.393065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.415313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1102/2199] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:55.419081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.423575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:55.447594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] MFA Rules not processed for user `4ea61f775e944d18bcd28293efb0e4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:55.449143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:55.508159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af2c61-8f98-40a0-ab91-706d35174c5f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.518608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.519272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.519565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.519825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.520491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.522464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.526107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1098/2200] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:55.530762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.542837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0d61-2339-481a-babb-6d847921f880 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.548531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.549178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.549559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.549980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1103/2201] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:55.550191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.550900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.553190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.553606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.566440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17853d1c-30fa-4868-bd3b-444f940673bc admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.573272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.574068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.574392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.574850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.575661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.577581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.583427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1099/2202] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:55.588415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.592954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1104/2203] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.594580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.609317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd605ea-ede1-4b52-b98b-9656919cd096 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.662598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301b25-8a75-4421-95a2-7bf7a7f0b4c6 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.668351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.668971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.669327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.669676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.670757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.672644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.679332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.681510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.682569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.683066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] PATH_INFO: `/v3/projects/f491382b69af476f83a2ae85c1a6c8a5/users/4438b83bdc3946e7aa1017cb7628a53e/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.697001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1100/2204] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:55.701069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.701887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f491382b69af476f83a2ae85c1a6c8a5, user_id=4438b83bdc3946e7aa1017cb7628a53e, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.704674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.713779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa0d8-92e4-491e-985a-541b0f016fec admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.723211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1105/2205] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:55 2022] PUT /identity/v3/projects/f491382b69af476f83a2ae85c1a6c8a5/users/4438b83bdc3946e7aa1017cb7628a53e/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:55.727742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.779159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:55.785262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.785924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.786205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.786585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.787619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.788753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.792119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:55.803827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1101/2206] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.805844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c6-d778-49c1-a88c-b7c01b67713d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.810808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.810965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.811589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.812019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.812373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.813208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.814899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.824371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb957d5-2f1c-44a0-b277-25e0449784d3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.826283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1106/2207] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:55.830597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.833545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.835449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.836572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.836917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] PATH_INFO: `/v3/projects/298cbade8fdd425b854ad915dda16cfb/users/095e58ce85b846849f3635c010725614/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.848612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3612af-bc20-4b76-a240-65d97b5fde73 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:55.858305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:55.859535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.859896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.860074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298cbade8fdd425b854ad915dda16cfb, user_id=095e58ce85b846849f3635c010725614, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.860324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] PATH_INFO: `/v3/projects/f491382b69af476f83a2ae85c1a6c8a5/users/4438b83bdc3946e7aa1017cb7628a53e/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.863069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.863818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f491382b69af476f83a2ae85c1a6c8a5, user_id=4438b83bdc3946e7aa1017cb7628a53e, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:55.867493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77be3d-c64a-45c3-96c1-c87036bb75d7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:55.879502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1102/2208] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:55 2022] PUT /identity/v3/projects/298cbade8fdd425b854ad915dda16cfb/users/095e58ce85b846849f3635c010725614/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:55.883862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:55.886405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1107/2209] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:55 2022] PUT /identity/v3/projects/f491382b69af476f83a2ae85c1a6c8a5/users/4438b83bdc3946e7aa1017cb7628a53e/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:55.897477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:55.897773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:55.899947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:55.937203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] MFA Rules not processed for user `4438b83bdc3946e7aa1017cb7628a53e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:55.938568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:55.960607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f962d-fb72-4a43-ad33-4780f24522a9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.045488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.046741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.047285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.047742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.048702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.048815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1108/2210] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:56.050667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.060252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:56.062535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:56.066594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1103/2211] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:56.070521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:56.081673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a9c1c-62c0-4972-a896-11a10e687a12 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.088571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.089514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.089928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.090308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] PATH_INFO: `/v3/projects/298cbade8fdd425b854ad915dda16cfb/users/095e58ce85b846849f3635c010725614/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.092449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298cbade8fdd425b854ad915dda16cfb, user_id=095e58ce85b846849f3635c010725614, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.095642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5267eed-094b-4e58-a8a6-a013bbe1e0a9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.107756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1104/2212] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:56 2022] PUT /identity/v3/projects/298cbade8fdd425b854ad915dda16cfb/users/095e58ce85b846849f3635c010725614/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:56.119592 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.119959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.120307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.133237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94776b-1834-4770-bf48-18736e7afc6b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.151148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] MFA Rules not processed for user `095e58ce85b846849f3635c010725614`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:56.152466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:56.191549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.192272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.192670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.193025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.215877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:56.217798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:56.244035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1105/2213] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:56.257076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:56.260429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:56.270384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.272099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.273940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6c4ac-412a-4191-b9b5-d0dcf02926bb None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.278392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.279100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.279488 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.279846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.290496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1109/2214] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:56.291986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.298234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab540-8d65-48c8-b22a-edd78d33564b service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.312820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1106/2215] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:56.489433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:56.612505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c862c-8a8a-4251-877f-2ffa9bc5467e service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.619417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.620295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.620625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.620919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] PATH_INFO: `/v3/users/4ea61f775e944d18bcd28293efb0e4c4` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.622509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea61f775e944d18bcd28293efb0e4c4)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.624840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.713079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea61f775e944d18bcd28293efb0e4c4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:56.713386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea61f775e944d18bcd28293efb0e4c4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:56.714390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea61f775e944d18bcd28293efb0e4c4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:56.733474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea61f775e944d18bcd28293efb0e4c4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:56.742568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea61f775e944d18bcd28293efb0e4c4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:56.757686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1110/2216] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:56 2022] DELETE /identity/v3/users/4ea61f775e944d18bcd28293efb0e4c4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:56.762425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.762826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.763098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.783546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:56.784773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:56.847142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1107/2217] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:56.857510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:56.858958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:56.906857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:56.922288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70589-a4d9-4d7d-af5e-0788470d3fed admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:56.926101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:56.926752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:56.927045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:56.927325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:56.937047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:56.938534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:56.948641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1111/2218] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:52:57.234466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:57.236027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:57.248884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2b6b1-7411-4c34-ada6-44a8edda438c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:57.253582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:57.254324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:57.254669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:57.255036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] PATH_INFO: `/v3/projects/897c75070b4d4bd2b8eed5ee5e5ce417` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:57.256289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897c75070b4d4bd2b8eed5ee5e5ce417)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:57.259119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:57.308913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897c75070b4d4bd2b8eed5ee5e5ce417', 'request_id': 'req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.316121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897c75070b4d4bd2b8eed5ee5e5ce417', 'request_id': 'req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.322391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897c75070b4d4bd2b8eed5ee5e5ce417', 'request_id': 'req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.333422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] The token cache is being invalidate because project 897c75070b4d4bd2b8eed5ee5e5ce417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:57.333703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.334360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.336161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1108/2219] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:57 2022] DELETE /identity/v3/projects/897c75070b4d4bd2b8eed5ee5e5ce417 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:57.340297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:57.350286 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdb896-c480-44b6-9f17-7e277f4282cf service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:57.406227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:57.406869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:57.407157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:57.407439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] PATH_INFO: `/v3/users/095e58ce85b846849f3635c010725614` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:57.408604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=095e58ce85b846849f3635c010725614)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:57.410586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:57.455403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095e58ce85b846849f3635c010725614'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.456063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095e58ce85b846849f3635c010725614'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.456677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095e58ce85b846849f3635c010725614'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.469642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095e58ce85b846849f3635c010725614'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.477174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095e58ce85b846849f3635c010725614'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.490109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1112/2220] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:52:57 2022] DELETE /identity/v3/users/095e58ce85b846849f3635c010725614 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:57.766320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:57.768070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:57.806455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e79c-edfe-432b-a5dd-a2f3be4477b9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:57.880297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:57.881107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:57.881398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:57.881724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] PATH_INFO: `/v3/projects/298cbade8fdd425b854ad915dda16cfb` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:57.883595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298cbade8fdd425b854ad915dda16cfb)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:57.885858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:57.887527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:57.940770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298cbade8fdd425b854ad915dda16cfb', 'request_id': 'req-7d6d23c6-de41-4c14-94e0-daba88337b38'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.956780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298cbade8fdd425b854ad915dda16cfb', 'request_id': 'req-7d6d23c6-de41-4c14-94e0-daba88337b38'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.964000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298cbade8fdd425b854ad915dda16cfb', 'request_id': 'req-7d6d23c6-de41-4c14-94e0-daba88337b38'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.976737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] The token cache is being invalidate because project 298cbade8fdd425b854ad915dda16cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:52:57.977039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.977695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7d6d23c6-de41-4c14-94e0-daba88337b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:52:57.979455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1109/2221] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:52:57 2022] DELETE /identity/v3/projects/298cbade8fdd425b854ad915dda16cfb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:57.983427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:57.983840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c8b0-8928-4153-bd63-3f25880bc5dc None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:57.984244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c8b0-8928-4153-bd63-3f25880bc5dc None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:57.984547 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c8b0-8928-4153-bd63-3f25880bc5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:57.984883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.004607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-45b6c8b0-8928-4153-bd63-3f25880bc5dc None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:58.006005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-45b6c8b0-8928-4153-bd63-3f25880bc5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.045423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4c30-0956-41ac-bdb6-d7440770b42a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.059738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:58.071243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1110/2222] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:58.079170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.079467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.079747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.099562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:58.100771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.102912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.103567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.103845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.104118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.105882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.109410 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1111/2223] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:52:58.113919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.123114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4f2ec-b84e-474b-91d2-6ceede42e5d4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.127888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.128503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.128781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.129052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.129736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:52:58.130071 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.131731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.143669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1112/2224] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:52:58.147916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.159102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdf022-7f29-4e38-8574-9b7989eae8af admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.163767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.164974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.165255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.165527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.166230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.167326 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.168115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.168760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.177742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1113/2225] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:58.196320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1113/2226] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:52:58.200558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.211523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972de9-40b6-45da-83ee-8dc51f20753b service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.274729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.275376 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.275724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.276058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.276738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.278856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.303851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1114/2227] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:58.305350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.317284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2309d82-1bf4-4f55-a084-0483b644bc5b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.324462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.324462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.324897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.325255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.326733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.328438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.340751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1114/2228] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:58.344771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.356960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f2645-2999-402f-93e1-5a17aeb7f005 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.362183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.362808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.363095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.363374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.364085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.365693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06284-0137-4af9-b9e3-6cb0a3f002f4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.377918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1115/2229] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:52:58.380952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.393461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e0c48-5e0f-4141-8149-fddef35d3553 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.402391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.403637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.404100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.404632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] PATH_INFO: `/v3/projects/808e82e923864110b68c76ee502b5303/users/652b5499c7c748e3b43692d3f28b5a83/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.425289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=808e82e923864110b68c76ee502b5303, user_id=652b5499c7c748e3b43692d3f28b5a83, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.428045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.443090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1115/2230] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:58 2022] PUT /identity/v3/projects/808e82e923864110b68c76ee502b5303/users/652b5499c7c748e3b43692d3f28b5a83/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:58.454389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.454752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.455042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.485516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] MFA Rules not processed for user `652b5499c7c748e3b43692d3f28b5a83`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:58.487116 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.529553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:58.558148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1116/2231] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:58.562931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.577941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:58.641417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8272-29da-4254-8664-c2e938eaeb5e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.646142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.646781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.647033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.647513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.648289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.650704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.683764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1116/2232] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:58.687045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.699388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bd46b-f62e-4ecc-bec9-9b6da3a4dd53 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.758900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.759694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.759980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.760263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.760935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.762909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.771576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.773384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.785187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1117/2233] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:52:58 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:52:58.789563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.798980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb975ee-b178-4ecd-bb5a-6bbbdf43746c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.803787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.804125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.805088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.805909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.806614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.808280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.818508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1118/2234] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:58.822668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.832272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996507-0b5e-417e-ac39-e04a3a070c63 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.837483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.837660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2081b-7e8c-4c4c-8fec-3e7ae75349fd admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.838176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.838463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.838746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] PATH_INFO: `/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a/users/900b470f00114bc4a9ac5a72d5c3e661/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.841504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.842160 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.842448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.842731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.844606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:58.854227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d761ed30b9f4d3f97e973b1f45d122a, user_id=900b470f00114bc4a9ac5a72d5c3e661, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.856903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.870382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1119/2235] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:58 2022] PUT /identity/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a/users/900b470f00114bc4a9ac5a72d5c3e661/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:52:58.874298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.922269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.923713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.934822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1117/2236] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:58.947372 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd814e-2c24-43a0-922a-9d66079a5f59 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.952241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.952865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.953152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.953435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.954198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.955814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad39bb-48db-47f6-8515-489b4b05375c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:58.969854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1120/2237] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:52:58.971722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:58.984152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd4c6-6e0a-4a88-8d7f-d3925f42baa0 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:58.989447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:58.990380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:58.990798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:58.991158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] PATH_INFO: `/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a/users/900b470f00114bc4a9ac5a72d5c3e661/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:58.993473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d761ed30b9f4d3f97e973b1f45d122a, user_id=900b470f00114bc4a9ac5a72d5c3e661, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:58.996207 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:59.011178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1118/2238] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:52:58 2022] PUT /identity/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a/users/900b470f00114bc4a9ac5a72d5c3e661/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:52:59.022581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:59.022861 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:59.024643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:59.066733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] MFA Rules not processed for user `900b470f00114bc4a9ac5a72d5c3e661`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:52:59.068075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:52:59.088026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:59.139377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1121/2239] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:52:59.150963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:59.191993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:59.209619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9888e6-71fe-4994-b530-64a5b73833bf admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:59.213953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:59.214591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:59.214872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:59.215145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:59.224064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:59.225579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:59.235297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1119/2240] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:52:59.311411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:52:59.321526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb3414-c5e0-4d61-833b-e1d600d4cdf0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:52:59.325335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:52:59.326001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:52:59.326287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:52:59.326589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:52:59.387697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:52:59.389302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777cb5-2303-40cc-9087-2b1e5de63f3f service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:52:59.399038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1122/2241] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:02.941333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:02.942764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.008263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f845015-fc49-4329-b559-2b02c3717a9b service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:03.012771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:03.013397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.013676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.013985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] PATH_INFO: `/v3/users/a20d5ba9a44e44d79ae8ec1622911bd4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.015153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20d5ba9a44e44d79ae8ec1622911bd4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:03.017063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:03.067515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20d5ba9a44e44d79ae8ec1622911bd4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.075734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20d5ba9a44e44d79ae8ec1622911bd4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.076479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20d5ba9a44e44d79ae8ec1622911bd4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.083373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20d5ba9a44e44d79ae8ec1622911bd4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.095657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20d5ba9a44e44d79ae8ec1622911bd4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.101727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1120/2242] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:02 2022] DELETE /identity/v3/users/a20d5ba9a44e44d79ae8ec1622911bd4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:03.106207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.106672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.106763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.127593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:03.128839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.191343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1123/2243] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:03.201700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:03.203119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.274517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c013d7-b946-4966-8c47-cec7504b470b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:03.278416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:03.279414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.279840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.280475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.299641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:03.306199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14358559-1baf-4624-aaad-e7000c5f98fd service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:03.314040 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:03.315546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.316860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:03.323940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1121/2244] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:03.343490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68089452-67a2-46d4-8ccc-e6046140e121 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:03.358928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:03.359926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.359926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.360338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] PATH_INFO: `/v3/users/7ec8e27fb3354ee09bda48bb3c8ab11e` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.364678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec8e27fb3354ee09bda48bb3c8ab11e)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:03.367477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:03.439321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec8e27fb3354ee09bda48bb3c8ab11e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.440425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec8e27fb3354ee09bda48bb3c8ab11e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.440980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec8e27fb3354ee09bda48bb3c8ab11e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.443535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:03.462250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec8e27fb3354ee09bda48bb3c8ab11e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.473558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec8e27fb3354ee09bda48bb3c8ab11e'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.501375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1124/2245] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:03 2022] DELETE /identity/v3/users/7ec8e27fb3354ee09bda48bb3c8ab11e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:03.506304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.506591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.506870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.546973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:03.550955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.654430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1122/2246] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:03.665448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:03.667501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.790813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8b335-cc4d-4d48-8355-56a810217c34 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:03.795214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:03.796129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.796716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.797272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.808719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:03.810633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:03.825650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1125/2247] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:03.846622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:03.848020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:03.874299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d9b3-c7f8-404f-aded-62561e2eb351 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:03.880371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:03.882799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:03.884007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:03.884522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] PATH_INFO: `/v3/projects/64bd06d514a349cebcf664be96c000b2` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:03.904282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bd06d514a349cebcf664be96c000b2)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:03.910027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:03.990272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bd06d514a349cebcf664be96c000b2', 'request_id': 'req-5a39b9b7-ea7c-438f-b87b-50abc25f2419'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:03.999557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bd06d514a349cebcf664be96c000b2', 'request_id': 'req-5a39b9b7-ea7c-438f-b87b-50abc25f2419'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.006004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bd06d514a349cebcf664be96c000b2', 'request_id': 'req-5a39b9b7-ea7c-438f-b87b-50abc25f2419'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.019700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] The token cache is being invalidate because project 64bd06d514a349cebcf664be96c000b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:04.020080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.020708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.022517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1123/2248] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:03 2022] DELETE /identity/v3/projects/64bd06d514a349cebcf664be96c000b2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:04.026732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.037458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0abed-0e68-4fab-b219-0d783afa54f2 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.107215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.107990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.108289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.108664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] PATH_INFO: `/v3/users/0c540725cc7b49f9a710e0eba9942349` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.110395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c540725cc7b49f9a710e0eba9942349)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.112772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.159776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.161282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.173233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c540725cc7b49f9a710e0eba9942349'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.176560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c540725cc7b49f9a710e0eba9942349'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.177348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c540725cc7b49f9a710e0eba9942349'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.177655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b9b7-ea7c-438f-b87b-50abc25f2419 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.183393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.184246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.184464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.184740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] PATH_INFO: `/v3/projects/6c507f2dd8b7406eaf84178ebcf0d1fc` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.186031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c507f2dd8b7406eaf84178ebcf0d1fc)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.188218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.193426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c540725cc7b49f9a710e0eba9942349'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.199693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:04.202486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cc9bf07-be0c-4ae5-9347-5e3d4e00771e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c540725cc7b49f9a710e0eba9942349'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.220117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1126/2249] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:04 2022] DELETE /identity/v3/users/0c540725cc7b49f9a710e0eba9942349 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:04.241757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c507f2dd8b7406eaf84178ebcf0d1fc', 'request_id': 'req-a195fa2e-3374-424c-8618-8de173548df8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.249853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c507f2dd8b7406eaf84178ebcf0d1fc', 'request_id': 'req-a195fa2e-3374-424c-8618-8de173548df8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.256202 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c507f2dd8b7406eaf84178ebcf0d1fc', 'request_id': 'req-a195fa2e-3374-424c-8618-8de173548df8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.272381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] The token cache is being invalidate because project 6c507f2dd8b7406eaf84178ebcf0d1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:04.272775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.275131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a195fa2e-3374-424c-8618-8de173548df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.277049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1124/2250] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:04 2022] DELETE /identity/v3/projects/6c507f2dd8b7406eaf84178ebcf0d1fc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:04.281750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.282105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.282388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.305413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:04.306663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.369950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1127/2251] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:04.379182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.379658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.380065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.394283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:04.401670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:04.403631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.412757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1125/2252] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:04.417729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.428998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a72e-ed4c-4dbc-87b0-6c4d23bad2b6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.434315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.434945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.435233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.435511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.436214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:04.436525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.438243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.451145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1128/2253] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:04.455508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.466152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4442bb-90b5-495d-8bd5-0fdb0340993c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.470899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.471517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.472177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.474966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.475658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.477624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.507082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1126/2254] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:04 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:04.511827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.524052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758a54-715c-495a-985c-cb8ee8aecf64 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.550959 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.553060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.598858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.599491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.600227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.600227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.600700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.602758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.634166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1129/2255] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:04 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:04.638131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.649708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f499f-70b8-4676-b1f8-23e79f8f6fea admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.651438 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aafa2-c606-4dc8-ab13-49647eb66ce0 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.654607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.655244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.655565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.655844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.656535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.656667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.657277 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.657612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.657917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] PATH_INFO: `/v3/projects/cbcb8456764b41da9cdbc91f13acc50d` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.658183 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.659080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcb8456764b41da9cdbc91f13acc50d)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.660987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.668320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1130/2256] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:53:04.672130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.682145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12289-0a13-4dfe-b7b4-c065b7120980 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.686786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.687405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.687686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.687960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.688833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.690696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.703463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1131/2257] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:53:04.707473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.711684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcb8456764b41da9cdbc91f13acc50d', 'request_id': 'req-8ef009a1-65cd-4c0b-8103-bf98f198ff71'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.718416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8cbd-3aa7-4134-ae68-417c7f644e89 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.719944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcb8456764b41da9cdbc91f13acc50d', 'request_id': 'req-8ef009a1-65cd-4c0b-8103-bf98f198ff71'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.725676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcb8456764b41da9cdbc91f13acc50d', 'request_id': 'req-8ef009a1-65cd-4c0b-8103-bf98f198ff71'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.737477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] The token cache is being invalidate because project cbcb8456764b41da9cdbc91f13acc50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:04.737766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.738469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.739996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1127/2258] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:04 2022] DELETE /identity/v3/projects/cbcb8456764b41da9cdbc91f13acc50d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:04.744092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.745423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.763104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:04.783934 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.785009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.785404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.785786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] PATH_INFO: `/v3/projects/8ee35c58905e48799f36ac25ea8a0840/users/87613d754dae46229cbc4c52476add5d/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.808469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee35c58905e48799f36ac25ea8a0840, user_id=87613d754dae46229cbc4c52476add5d, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.813546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9eaa1-5706-41de-83c7-f4337dae9e07 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.829061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef009a1-65cd-4c0b-8103-bf98f198ff71 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:04.830800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1132/2259] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:04 2022] PUT /identity/v3/projects/8ee35c58905e48799f36ac25ea8a0840/users/87613d754dae46229cbc4c52476add5d/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:04.841275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.841462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:04.841589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.841865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.871354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] MFA Rules not processed for user `87613d754dae46229cbc4c52476add5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:04.872513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.894857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:04.895500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:04.895785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:04.896069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] PATH_INFO: `/v3/users/4438b83bdc3946e7aa1017cb7628a53e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:04.897239 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4438b83bdc3946e7aa1017cb7628a53e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:04.899206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:04.941863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1133/2260] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:04.947830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4438b83bdc3946e7aa1017cb7628a53e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.954754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:04.955980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4438b83bdc3946e7aa1017cb7628a53e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.956852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:04.956970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4438b83bdc3946e7aa1017cb7628a53e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.964777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4438b83bdc3946e7aa1017cb7628a53e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.979078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4438b83bdc3946e7aa1017cb7628a53e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:04.985399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1128/2261] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:04 2022] DELETE /identity/v3/users/4438b83bdc3946e7aa1017cb7628a53e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:05.043446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e39a-418e-4485-b5f5-fa6f0dd6daf5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.118469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.119240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.119599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.119948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.122309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:05.162354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:05.199740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.201412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3960b8-bda3-4d04-bd9a-d5d8182c5bf7 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.212007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1134/2262] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:05.330927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.332505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:05.410626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e34e8-84e3-4436-a135-3662c1e0976e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.415803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.416447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.416727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.417000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] PATH_INFO: `/v3/projects/f491382b69af476f83a2ae85c1a6c8a5` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.418236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f491382b69af476f83a2ae85c1a6c8a5)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.420182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.459037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:05.470801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f491382b69af476f83a2ae85c1a6c8a5', 'request_id': 'req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:05.478746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f491382b69af476f83a2ae85c1a6c8a5', 'request_id': 'req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:05.484538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f491382b69af476f83a2ae85c1a6c8a5', 'request_id': 'req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:05.496919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] The token cache is being invalidate because project f491382b69af476f83a2ae85c1a6c8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:05.497312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:05.497996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-fca7cd55-fe51-4e87-a08b-0e9ede11b9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:05.499935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1129/2263] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:05 2022] DELETE /identity/v3/projects/f491382b69af476f83a2ae85c1a6c8a5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:05.505167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.505516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.505924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.528322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:05.529650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:05.610618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1135/2264] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:05.618523 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.618934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.619284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.654922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:05.656442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:05.669955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1130/2265] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:05.671363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.685031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca124d0-72cf-4a7c-a294-680ebe804bf2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.707262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.707911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.708338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.708562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.709161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:05.709845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.711200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.727545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1136/2266] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:05.730334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.740391 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a695e-fcd2-4164-a70b-9b0df477f517 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.746809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.747473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.747754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.748028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.748808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.751097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.785460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1131/2267] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:05 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:05.786940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.797177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aeb1e-b1ed-4a9e-a435-e4a88bab5753 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.859583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.860205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.860492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.860775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.861707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.863672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.887922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1137/2268] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:05 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:05.891832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.902455 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205a28-2010-4337-8af0-a08993cb5ed7 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.907629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.908242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.908554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.908836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.909686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.911415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.922394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1132/2269] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:53:05.926333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.936981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90cbb2-7771-4883-8049-dfa6af73b8f9 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.941940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.942554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.942839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.943119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.943825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.946303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9ea52-74ac-4438-8266-e18cb278b9f1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:05.958300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1138/2270] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:05.962457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:05.972454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7e90-f353-4d78-97fe-ca868862457a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:05.977742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:05.978490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:05.978773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:05.979053 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] PATH_INFO: `/v3/projects/de31120003234887803959a6fdf5681f/users/6d0cb8558e0d4cef81b5d740776a1dd6/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:05.994749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de31120003234887803959a6fdf5681f, user_id=6d0cb8558e0d4cef81b5d740776a1dd6, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:05.997402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:06.010248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1133/2271] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:05 2022] PUT /identity/v3/projects/de31120003234887803959a6fdf5681f/users/6d0cb8558e0d4cef81b5d740776a1dd6/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:06.015264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d50d-aa12-48a2-b6aa-f33cbb53a69a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:06.015555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d50d-aa12-48a2-b6aa-f33cbb53a69a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:06.015834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d50d-aa12-48a2-b6aa-f33cbb53a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:06.034949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-93b8d50d-aa12-48a2-b6aa-f33cbb53a69a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:06.036173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-93b8d50d-aa12-48a2-b6aa-f33cbb53a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:06.065801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:06.097175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1139/2272] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:06.108319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:06.110263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:06.181095 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be541-67ec-4da3-881d-d4013798ac5b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:06.187355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:06.188372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:06.188372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:06.188667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:06.201736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:06.203854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:06.214747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1134/2273] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:07.146646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1040-57e5-4e50-a18c-e397ef35824c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:07.147204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1040-57e5-4e50-a18c-e397ef35824c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:07.147302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1040-57e5-4e50-a18c-e397ef35824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:07.188349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1e1f1040-57e5-4e50-a18c-e397ef35824c None None] MFA Rules not processed for user `6d0cb8558e0d4cef81b5d740776a1dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:07.188622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1e1f1040-57e5-4e50-a18c-e397ef35824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:07.271405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1140/2274] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:07.286113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:07.287834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:07.368169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5862b-6388-4b92-a454-08d531381bc4 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:07.372127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:07.372746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:07.373027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:07.373301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:07.382788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:07.384491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:07.394689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1135/2275] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:08.806670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e96f-90e9-43eb-9e11-2b0f9ec75d8e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:08.807243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e96f-90e9-43eb-9e11-2b0f9ec75d8e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:08.807243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e96f-90e9-43eb-9e11-2b0f9ec75d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:08.826261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6f48e96f-90e9-43eb-9e11-2b0f9ec75d8e None None] MFA Rules not processed for user `6d0cb8558e0d4cef81b5d740776a1dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:08.827469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6f48e96f-90e9-43eb-9e11-2b0f9ec75d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:08.834520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1141/2276] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:14.852572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:14.854022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:14.869138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f082f-33e4-4a33-b247-e7b3a6f21d51 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:14.873749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:14.874409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:14.874686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:14.874962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] PATH_INFO: `/v3/users/652b5499c7c748e3b43692d3f28b5a83` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:14.876107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=652b5499c7c748e3b43692d3f28b5a83)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:14.878039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:14.879704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:14.931769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652b5499c7c748e3b43692d3f28b5a83'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:14.939225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652b5499c7c748e3b43692d3f28b5a83'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:14.939850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652b5499c7c748e3b43692d3f28b5a83'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:14.947364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652b5499c7c748e3b43692d3f28b5a83'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:14.959006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652b5499c7c748e3b43692d3f28b5a83'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:14.965074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1136/2277] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:14 2022] DELETE /identity/v3/users/652b5499c7c748e3b43692d3f28b5a83 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:14.969672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:14.970177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:14.970276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:14.995392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:14.996616 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:15.059887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1142/2278] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:15.069264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:15.070768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:15.132199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d9bda-4a42-48ad-958f-2df0b2a5e6fc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:15.135831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:15.136450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:15.136732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:15.137008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:15.146017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:15.147440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:15.156910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1137/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:15.479886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:15.481393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:15.497349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09b96-9c08-48a5-a791-84d3493b361f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:15.504280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:15.504983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:15.505259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:15.505541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] PATH_INFO: `/v3/projects/808e82e923864110b68c76ee502b5303` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:15.506921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808e82e923864110b68c76ee502b5303)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:15.509942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:15.561928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808e82e923864110b68c76ee502b5303', 'request_id': 'req-45a263c0-bd33-4183-aecd-89c7bb6ac672'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.564005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:15.570121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808e82e923864110b68c76ee502b5303', 'request_id': 'req-45a263c0-bd33-4183-aecd-89c7bb6ac672'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.579009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808e82e923864110b68c76ee502b5303', 'request_id': 'req-45a263c0-bd33-4183-aecd-89c7bb6ac672'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.590752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] The token cache is being invalidate because project 808e82e923864110b68c76ee502b5303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:15.591078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.591681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.593328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1143/2280] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:15 2022] DELETE /identity/v3/projects/808e82e923864110b68c76ee502b5303 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:15.597682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:15.609027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b3fc-4f50-4824-8c06-a73eef084c36 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:15.668857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:15.669432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:15.669730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:15.670043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] PATH_INFO: `/v3/users/900b470f00114bc4a9ac5a72d5c3e661` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:15.671250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900b470f00114bc4a9ac5a72d5c3e661)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:15.673233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:15.697529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:15.723432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900b470f00114bc4a9ac5a72d5c3e661'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.732191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900b470f00114bc4a9ac5a72d5c3e661'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.733051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900b470f00114bc4a9ac5a72d5c3e661'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.741420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900b470f00114bc4a9ac5a72d5c3e661'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.753306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e4f8c971-1cbe-48e9-b301-529383d265f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900b470f00114bc4a9ac5a72d5c3e661'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:15.759814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1138/2281] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:15 2022] DELETE /identity/v3/users/900b470f00114bc4a9ac5a72d5c3e661 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:16.050478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.052106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:16.066464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a263c0-bd33-4183-aecd-89c7bb6ac672 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.129778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.130443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.130725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.131002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] PATH_INFO: `/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.132875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d761ed30b9f4d3f97e973b1f45d122a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.135092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.191809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d761ed30b9f4d3f97e973b1f45d122a', 'request_id': 'req-a0769275-1699-4d07-968e-db8534331f99'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:16.201455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d761ed30b9f4d3f97e973b1f45d122a', 'request_id': 'req-a0769275-1699-4d07-968e-db8534331f99'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:16.209088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d761ed30b9f4d3f97e973b1f45d122a', 'request_id': 'req-a0769275-1699-4d07-968e-db8534331f99'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:16.219517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] The token cache is being invalidate because project 1d761ed30b9f4d3f97e973b1f45d122a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:16.219804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:16.220423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a0769275-1699-4d07-968e-db8534331f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:16.221970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1144/2282] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:16 2022] DELETE /identity/v3/projects/1d761ed30b9f4d3f97e973b1f45d122a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:16.227086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.227566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.227683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.248892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:16.250144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:16.314988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1139/2283] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:16.324155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.324541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.324720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.344481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:16.345686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:16.353713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1145/2284] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:16.358069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.369210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d2e4-17e2-4da6-ba59-318768708ee9 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.373774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.374409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.374691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.374972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.375670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:16.375974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.377563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.390267 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1140/2285] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:16.395285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.405457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9c420-3607-4a6d-9f1c-96a18623ddc4 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.410239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.410857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.411141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.411419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.412125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.414113 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.443060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1146/2286] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:16.448301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.458757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20991-9f61-42f1-bbb0-dff5a7fb9afa admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.520078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.520807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.521087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.521362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.522191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.524059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.548402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1141/2287] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:16.553563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.566510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae529fd5-a57d-42d2-a820-a3bfb8dcf844 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.574833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.575648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.575941 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.576223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.576943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.578747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.595854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1147/2288] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:16.599850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.611957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111456d5-ec8f-48d0-806c-e5a1607e5c04 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.617349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.618012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.618294 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.618571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.619268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.620894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21546003-1436-42f7-b01b-63e13066d18c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.632652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1142/2289] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:16.636836 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.648387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03b5f-df38-478f-ac0c-4224dee88ec9 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.653105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.653761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.654074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.654353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] PATH_INFO: `/v3/projects/c48301522e2a4b6aa711656496fe2067/users/637d5a6199fb4dd7ae2e0b459a708e4b/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.670511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48301522e2a4b6aa711656496fe2067, user_id=637d5a6199fb4dd7ae2e0b459a708e4b, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.673160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.690845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1148/2290] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:16 2022] PUT /identity/v3/projects/c48301522e2a4b6aa711656496fe2067/users/637d5a6199fb4dd7ae2e0b459a708e4b/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:16.703978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.704198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.704573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.718524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:16.734574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] MFA Rules not processed for user `637d5a6199fb4dd7ae2e0b459a708e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:16.736580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:16.808972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1143/2291] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:16.813944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.824218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:16.884950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f144-29a2-4542-b135-26c817de12b8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.890211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.890825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:16.891108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:16.891384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:16.892057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:16.894150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:16.921736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1149/2292] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:16.926165 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:16.938248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd8446-1b06-431c-b315-b4907e752081 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:16.999372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:16.999894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.000177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.000449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.001125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.003087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.026995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1144/2293] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:16 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:17.028239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.041023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45dda-ec09-4127-91e5-689ed4afeacc admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.046052 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.046668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.047035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.047347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.048081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.049707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.060881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1150/2294] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:17.065100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.075168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333cca8-052e-43d6-92f5-91b6f161912c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.079729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.080376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.080653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.080926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] PATH_INFO: `/v3/projects/c0dd7388fd5247df8fa37c181015808a/users/44962cb933bf4056a0ef8ce62ecd92c6/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.097382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dd7388fd5247df8fa37c181015808a, user_id=44962cb933bf4056a0ef8ce62ecd92c6, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.100056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.114303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1145/2295] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:17 2022] PUT /identity/v3/projects/c0dd7388fd5247df8fa37c181015808a/users/44962cb933bf4056a0ef8ce62ecd92c6/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:17.118285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.128382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62131ab-aa87-4240-835d-98c998e3fe05 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.190291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.190920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.191204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.191482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.192177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.193777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55374-91f6-4ceb-a3cf-42a67336e57e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.203964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1151/2296] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:17.208252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.220170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f2ea-6b64-4b5d-b97c-7674dd7ede90 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.224984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.225708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.226047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.226325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] PATH_INFO: `/v3/projects/c0dd7388fd5247df8fa37c181015808a/users/44962cb933bf4056a0ef8ce62ecd92c6/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.228414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dd7388fd5247df8fa37c181015808a, user_id=44962cb933bf4056a0ef8ce62ecd92c6, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.231110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.243029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1146/2297] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:17 2022] PUT /identity/v3/projects/c0dd7388fd5247df8fa37c181015808a/users/44962cb933bf4056a0ef8ce62ecd92c6/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:17.253639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.253902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.254188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.282576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] MFA Rules not processed for user `44962cb933bf4056a0ef8ce62ecd92c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:17.283833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:17.358018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1152/2298] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:17.371011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.372802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:17.441088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:17.445471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb719c-3674-4578-9314-e5c678b2b02a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.450900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.451648 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.451929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.452203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.463186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.464646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.474194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1147/2299] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:17.552633 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:17.558279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:17.565145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd19a3-fad3-4713-b337-91bee029c227 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:17.569180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:17.570018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:17.570232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:17.570511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:17.638748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:17.640913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fbba-5b50-4570-9b16-ebfe6e104f02 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:17.656214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1153/2300] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:20.482280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:20.553123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7039-2bc5-4e02-bcdf-11d35fed96ae service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:20.558445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:20.559081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:20.559361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:20.559632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] PATH_INFO: `/v3/users/637d5a6199fb4dd7ae2e0b459a708e4b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:20.560790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637d5a6199fb4dd7ae2e0b459a708e4b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:20.562724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:20.616924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637d5a6199fb4dd7ae2e0b459a708e4b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:20.625620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637d5a6199fb4dd7ae2e0b459a708e4b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:20.626644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637d5a6199fb4dd7ae2e0b459a708e4b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:20.634361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637d5a6199fb4dd7ae2e0b459a708e4b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:20.646186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637d5a6199fb4dd7ae2e0b459a708e4b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:20.653023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1148/2301] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:20 2022] DELETE /identity/v3/users/637d5a6199fb4dd7ae2e0b459a708e4b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:20.657595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:20.658117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:20.658227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:20.679362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:20.680562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:20.743472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1154/2302] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:20.753211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:20.754668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:20.825376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc76779-0468-4534-b35b-1d1e27b92314 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:20.829260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:20.829965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:20.830252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:20.830526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:20.840941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:20.842406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:20.852299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1149/2303] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:21.136751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:21.138273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:21.154168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2aa14-d090-4116-97d2-f7a990dff06e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:21.159156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:21.159827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:21.160158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:21.160478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] PATH_INFO: `/v3/projects/c48301522e2a4b6aa711656496fe2067` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:21.161740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48301522e2a4b6aa711656496fe2067)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:21.164125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:21.221960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48301522e2a4b6aa711656496fe2067', 'request_id': 'req-1b417551-cc78-4761-bd09-ec39d15b990d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.228418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48301522e2a4b6aa711656496fe2067', 'request_id': 'req-1b417551-cc78-4761-bd09-ec39d15b990d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.240858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48301522e2a4b6aa711656496fe2067', 'request_id': 'req-1b417551-cc78-4761-bd09-ec39d15b990d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.251922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] The token cache is being invalidate because project c48301522e2a4b6aa711656496fe2067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:21.252270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.252877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.257502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1155/2304] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:21 2022] DELETE /identity/v3/projects/c48301522e2a4b6aa711656496fe2067 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:21.265147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:21.276350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0140-3eff-48f0-a8ca-918b2acf8f9f service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:21.285992 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:21.345389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:21.346069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:21.346351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:21.346627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] PATH_INFO: `/v3/users/44962cb933bf4056a0ef8ce62ecd92c6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:21.347792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44962cb933bf4056a0ef8ce62ecd92c6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:21.349924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:21.399411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44962cb933bf4056a0ef8ce62ecd92c6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.406742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44962cb933bf4056a0ef8ce62ecd92c6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.407352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44962cb933bf4056a0ef8ce62ecd92c6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.415823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44962cb933bf4056a0ef8ce62ecd92c6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.428501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a5f3f389-0a6d-476d-922c-7ca82f10cb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44962cb933bf4056a0ef8ce62ecd92c6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.435094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1150/2305] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:21 2022] DELETE /identity/v3/users/44962cb933bf4056a0ef8ce62ecd92c6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:21.711882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:21.713386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:21.729709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417551-cc78-4761-bd09-ec39d15b990d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:21.752814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:21.792227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:21.792890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:21.793179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:21.793465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] PATH_INFO: `/v3/projects/c0dd7388fd5247df8fa37c181015808a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:21.794696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dd7388fd5247df8fa37c181015808a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:21.796624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:21.848517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dd7388fd5247df8fa37c181015808a', 'request_id': 'req-216e107b-8dc4-4119-877b-695b548aeb27'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.855317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dd7388fd5247df8fa37c181015808a', 'request_id': 'req-216e107b-8dc4-4119-877b-695b548aeb27'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.863378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dd7388fd5247df8fa37c181015808a', 'request_id': 'req-216e107b-8dc4-4119-877b-695b548aeb27'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.877832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] The token cache is being invalidate because project c0dd7388fd5247df8fa37c181015808a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:21.878132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.878800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-216e107b-8dc4-4119-877b-695b548aeb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:21.880327 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1156/2306] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:21 2022] DELETE /identity/v3/projects/c0dd7388fd5247df8fa37c181015808a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:21.885663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:21.886236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:21.886408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:21.908727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:21.909861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:21.970692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1151/2307] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:21.980028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:21.980545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:21.980895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.002935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:22.004147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:22.012678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1157/2308] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:22.016929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.027583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbebd5-4795-4eda-b0f3-5ad8fb8a171f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.032201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.032809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.033097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.033373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.034108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:22.034415 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.036044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.052136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1152/2309] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:22.057212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.066731 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae529ec-35e2-4a03-b328-86d35a56bd93 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.072162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.072806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.073090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.073368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.074151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.076084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.104079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1158/2310] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:22.107863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.119345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7b42e-d5f6-48b2-bedb-1f900d085436 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.136737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:22.180205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.180728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.181008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.181282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.181993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.183895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.206383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1153/2311] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:22.211195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.223062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc6087-702e-4bf5-ac63-97e4bc5b23a3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.227853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.228497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.228765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.229043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.229830 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.231553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.243651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1159/2312] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:22.247928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.259721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837862f-76a1-43d6-9648-ab2feff9b24f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.264784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.265501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.265970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.266281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.267022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.268643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5e32d-a9b5-4e75-ae2c-0a0074a07d5a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.280068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1154/2313] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:22.286965 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.296990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab8690-a128-4827-a825-93419c2b2a62 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.302156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.302842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.303143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.303428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] PATH_INFO: `/v3/projects/ee8ff58bc697449e96ada64d87885095/users/b32b8e45bd7141969993112acefbb1b2/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.319206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8ff58bc697449e96ada64d87885095, user_id=b32b8e45bd7141969993112acefbb1b2, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.323163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.335769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1160/2314] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:22 2022] PUT /identity/v3/projects/ee8ff58bc697449e96ada64d87885095/users/b32b8e45bd7141969993112acefbb1b2/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:22.346890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.347175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.347460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.376906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] MFA Rules not processed for user `b32b8e45bd7141969993112acefbb1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:22.378172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:22.456006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1155/2315] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:22.460469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.515657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:22.528312 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d229-71d1-4315-a75c-9f15337b0c13 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.534146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.534765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.535044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.535319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.535993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.538445 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.566782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1161/2316] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:22.574273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.584958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0b733-3ed1-42bf-871f-af4ba0fdcfbc None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.647618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.648453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.648825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.649224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.650023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.652147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.677051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1156/2317] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:22.681672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.692632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c348d-0d28-48d0-bb60-1420ba0b140a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.697480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.698136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.698424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.698705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.699406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.700997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.712072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1162/2318] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:22.716890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.728105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7912-0f95-43a3-82f8-b2935d040080 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.732608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.733260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.733541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.733838 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] PATH_INFO: `/v3/projects/29cdc49457a14a229a4d23b791addcad/users/a0c6f94d5fd24ab8a7a905b7ff39b81d/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.750166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cdc49457a14a229a4d23b791addcad, user_id=a0c6f94d5fd24ab8a7a905b7ff39b81d, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.752832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.755238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:22.767346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1157/2319] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:22 2022] PUT /identity/v3/projects/29cdc49457a14a229a4d23b791addcad/users/a0c6f94d5fd24ab8a7a905b7ff39b81d/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:22.771256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.781865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fe5bd-2fc0-497c-a8b5-2300289fd213 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.840127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.840796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.841077 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.841354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.842078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.843866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa183e8-9e6d-4833-b66f-968345a34c74 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.855418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1163/2320] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:22.859867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:22.871476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb128c5-1e66-499b-99b8-4fb31bd8dc67 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:22.876230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:22.876895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.877181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.877459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] PATH_INFO: `/v3/projects/29cdc49457a14a229a4d23b791addcad/users/a0c6f94d5fd24ab8a7a905b7ff39b81d/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.879469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cdc49457a14a229a4d23b791addcad, user_id=a0c6f94d5fd24ab8a7a905b7ff39b81d, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:22.882591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:22.894278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1158/2321] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:22 2022] PUT /identity/v3/projects/29cdc49457a14a229a4d23b791addcad/users/a0c6f94d5fd24ab8a7a905b7ff39b81d/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:22.905049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:22.905410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:22.905695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:22.934858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] MFA Rules not processed for user `a0c6f94d5fd24ab8a7a905b7ff39b81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:22.936100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:23.008088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1164/2322] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:23.018654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:23.020458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:23.080113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d264-caa2-44d5-91db-9a4ffb960273 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:23.084197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:23.085649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:23.086023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:23.086368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:23.097170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:23.098965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:23.110292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1159/2323] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:23.157223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:23.158689 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:23.171282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114ff2-3964-42ff-bfcc-77d2e44a82d0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:23.174994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:23.175602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:23.176072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:23.176197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:23.223550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:23.238471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:23.239858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f749a-940b-4a3f-b323-3ea3697807d9 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:23.249539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1165/2324] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:26.599068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:26.661467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1783-4780-443f-b759-c24e73e4d6e9 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:26.666252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:26.666893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:26.667176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:26.667457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] PATH_INFO: `/v3/users/b32b8e45bd7141969993112acefbb1b2` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:26.668619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32b8e45bd7141969993112acefbb1b2)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:26.670622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:26.719944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32b8e45bd7141969993112acefbb1b2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:26.727375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32b8e45bd7141969993112acefbb1b2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:26.728061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32b8e45bd7141969993112acefbb1b2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:26.735034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32b8e45bd7141969993112acefbb1b2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:26.747461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32b8e45bd7141969993112acefbb1b2'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:26.753284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1160/2325] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:26 2022] DELETE /identity/v3/users/b32b8e45bd7141969993112acefbb1b2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:26.758450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:26.758916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:26.758916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:26.780854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:26.782245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:26.844146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1166/2326] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:26.854061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:26.855456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:26.860810 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:26.920120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea12a8c-3dd2-4332-a0d3-2c5cf9495e96 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:26.923936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:26.924521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:26.924802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:26.925081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:26.935530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:26.936951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:26.946590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1161/2327] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:27.220499 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:27.221996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:27.235388 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63bab-880a-4325-b796-b758126bfb52 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:27.243812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:27.244642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:27.245033 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:27.245410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] PATH_INFO: `/v3/projects/ee8ff58bc697449e96ada64d87885095` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:27.254143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8ff58bc697449e96ada64d87885095)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:27.256153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:27.312961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8ff58bc697449e96ada64d87885095', 'request_id': 'req-1bf14171-5b71-4f87-b632-9d79d65945ce'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.320353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8ff58bc697449e96ada64d87885095', 'request_id': 'req-1bf14171-5b71-4f87-b632-9d79d65945ce'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.331209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8ff58bc697449e96ada64d87885095', 'request_id': 'req-1bf14171-5b71-4f87-b632-9d79d65945ce'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.347422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] The token cache is being invalidate because project ee8ff58bc697449e96ada64d87885095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:27.347734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.348369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.349914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1167/2328] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:27 2022] DELETE /identity/v3/projects/ee8ff58bc697449e96ada64d87885095 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:27.354662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:27.366000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685540e-012f-4d4c-9c87-cc6150e0e166 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:27.423022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:27.423693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:27.423981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:27.424262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] PATH_INFO: `/v3/users/a0c6f94d5fd24ab8a7a905b7ff39b81d` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:27.425434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c6f94d5fd24ab8a7a905b7ff39b81d)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:27.427387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:27.472694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c6f94d5fd24ab8a7a905b7ff39b81d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.480094 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c6f94d5fd24ab8a7a905b7ff39b81d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.480716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c6f94d5fd24ab8a7a905b7ff39b81d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.487861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c6f94d5fd24ab8a7a905b7ff39b81d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.500107 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-4d37f59d-444b-4792-9f1e-98a66b5dfbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c6f94d5fd24ab8a7a905b7ff39b81d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:27.506105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1162/2329] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:27 2022] DELETE /identity/v3/users/a0c6f94d5fd24ab8a7a905b7ff39b81d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:27.808732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:27.811140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:27.844890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14171-5b71-4f87-b632-9d79d65945ce admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:27.928364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:27.928364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:27.928684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:27.928807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] PATH_INFO: `/v3/projects/29cdc49457a14a229a4d23b791addcad` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:27.930434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cdc49457a14a229a4d23b791addcad)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:27.932743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:27.948471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:28.008629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cdc49457a14a229a4d23b791addcad', 'request_id': 'req-0cf639d9-e0ba-4d50-8e84-72c99c494a55'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:28.016098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cdc49457a14a229a4d23b791addcad', 'request_id': 'req-0cf639d9-e0ba-4d50-8e84-72c99c494a55'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:28.032300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cdc49457a14a229a4d23b791addcad', 'request_id': 'req-0cf639d9-e0ba-4d50-8e84-72c99c494a55'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:28.048694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] The token cache is being invalidate because project 29cdc49457a14a229a4d23b791addcad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:28.048993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:28.049670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0cf639d9-e0ba-4d50-8e84-72c99c494a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:28.051298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1168/2330] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:27 2022] DELETE /identity/v3/projects/29cdc49457a14a229a4d23b791addcad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:28.057130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.058139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.058653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.080987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:28.082500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:28.103955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:28.150263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1163/2331] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:28.159644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.159994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.160278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.180981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:28.182254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:28.190819 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1169/2332] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:28.195240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.205924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d806-6b89-4c7f-a9ee-c1da5fbc01f0 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.211596 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.212411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.212725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.213037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.213891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:28.214234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.216302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.232657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1164/2333] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:28.233847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.244679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455de227-0055-4d39-b0a6-0ff6fd780077 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.249972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.250601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.250891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.251173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.251853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.253765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.286367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1170/2334] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:28.287773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.298789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60bee-6099-418d-b4c5-7cd98cbfa29a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.360671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.361604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.362001 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.362351 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.363462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.365608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.398527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1165/2335] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:28.399685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.411150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25e469-e376-4c31-8d1f-5c5e1131aed8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.426662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.427353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.427644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.428050 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.428772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.430463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.442825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1171/2336] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:28.447417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.458426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732864a-61d0-44a2-89ef-77aafe87c7ae admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.463862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.464473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.464757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.465034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.465733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.467365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38f1f3-8ce7-415c-a5d2-311b3bd64f73 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.484086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1166/2337] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:28.485426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.498833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ff167-6b10-493e-a54a-53a3ff2a0277 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.503703 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.504504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.504795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.505079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] PATH_INFO: `/v3/projects/b7d47a781ea2427b81ad99847a099fd2/users/197d3ff34be14da6a84213f04eb9b128/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.525747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d47a781ea2427b81ad99847a099fd2, user_id=197d3ff34be14da6a84213f04eb9b128, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.529345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.554983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1172/2338] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:28 2022] PUT /identity/v3/projects/b7d47a781ea2427b81ad99847a099fd2/users/197d3ff34be14da6a84213f04eb9b128/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:28.565177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.565517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.565795 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.597475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] MFA Rules not processed for user `197d3ff34be14da6a84213f04eb9b128`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:28.598726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:28.668514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1167/2339] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:28.672834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.742762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b717ca-8dab-4c52-baef-d0b2bd670a6e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.748025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.748663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.748949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.749257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.749961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.751880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.783001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1173/2340] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:28.784352 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.796237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37661-df5f-4711-ba4c-3fe6b4585e8b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.813133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:28.856572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.857191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.857473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.857750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.858437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.860339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.891531 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1168/2341] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:28 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:28.892808 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.906062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4cdb-de35-4624-98d2-0239f107206e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.912224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.914573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.914573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.914573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.915064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.916747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.928889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1174/2342] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:28.933639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.947421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1a3b8-89e1-434f-a653-ec9999505789 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.952381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.953983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.954490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.955800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:28.956573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:28.958948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642153c2-d22e-4bec-bc72-8d9372e9061b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:28.971803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1169/2343] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:53:28.976015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:28.987912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ada4c-f3ec-40f9-bf19-5c43570ebb5e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:28.994572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:28.995236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:28.995701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:28.995987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] PATH_INFO: `/v3/projects/30d89825afce455f9fcc58b6e1f33a12/users/094e4578685649098fa87f478748faa0/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.000776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:29.021355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d89825afce455f9fcc58b6e1f33a12, user_id=094e4578685649098fa87f478748faa0, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.025503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.056698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1175/2344] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:28 2022] PUT /identity/v3/projects/30d89825afce455f9fcc58b6e1f33a12/users/094e4578685649098fa87f478748faa0/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:29.067572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.067572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.067572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.099912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] MFA Rules not processed for user `094e4578685649098fa87f478748faa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:29.101200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:29.177003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1170/2345] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:29.182065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.251913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef35d-57a3-4023-8a73-9f7906f00cc5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.257992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.259251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.259722 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.260070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.260971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.274060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.297856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1176/2346] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:29 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:29.301330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.318370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a18d-bc62-42e1-8cf0-3c8891b8dd64 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.394884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.395505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.395792 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.396066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.396739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.398766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.425843 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1171/2347] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:29 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:29.429091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.446030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c8c9-1342-4852-83e6-dee45d2b54b3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.450739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.451370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.451664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.451943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.452648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.454322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.466988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1177/2348] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:29.471336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.482106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3d59-9589-45a4-8919-bc2bb44cdb7f admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.487655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.490579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.490942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.491300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] PATH_INFO: `/v3/projects/f6d205ddd11741c98a9ee3da0a813625/users/328d9d9ddb554285b31656fbb63269b4/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.508452 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d205ddd11741c98a9ee3da0a813625, user_id=328d9d9ddb554285b31656fbb63269b4, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.511174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.513400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:29.529103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1172/2349] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:29 2022] PUT /identity/v3/projects/f6d205ddd11741c98a9ee3da0a813625/users/328d9d9ddb554285b31656fbb63269b4/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:29.530459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.541646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bbb6c-452c-4537-a1da-552c2d6b0fc3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.626005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.626643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.626932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.627211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.627920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.629679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8d479-8eff-4d99-b9b8-561b7d969c22 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.644918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1178/2350] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:29.649836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.660945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc420-9731-4b0d-9bf5-a99545e62af8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.667754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.668472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.668756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.669035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] PATH_INFO: `/v3/projects/f6d205ddd11741c98a9ee3da0a813625/users/328d9d9ddb554285b31656fbb63269b4/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.671203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d205ddd11741c98a9ee3da0a813625, user_id=328d9d9ddb554285b31656fbb63269b4, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.674063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.688408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1173/2351] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:29 2022] PUT /identity/v3/projects/f6d205ddd11741c98a9ee3da0a813625/users/328d9d9ddb554285b31656fbb63269b4/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:29.700938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.701297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.701681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.734674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] MFA Rules not processed for user `328d9d9ddb554285b31656fbb63269b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:29.736475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:29.782221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:29.808844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1179/2352] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:29.820260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.822144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:29.882423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520c0d-a681-4ba8-ba9f-e76d730f42ad admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.887269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.888082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.888432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.888741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:29.898818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:29.900251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:29.909874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1174/2353] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:29.959443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:29.969947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159091b-a939-4c3d-b158-3bc164a7f2b3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:29.973603 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:29.974277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:29.974566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:29.974847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:30.046826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:30.048105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05052-00a7-4e92-8594-ff840ef5dccd service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:30.059476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1180/2354] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:34.097845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:34.159475 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c20e0e-2446-4eee-b0cd-ba52885c5d7e service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:34.164091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:34.164719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:34.165002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:34.165274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] PATH_INFO: `/v3/users/197d3ff34be14da6a84213f04eb9b128` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:34.166437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=197d3ff34be14da6a84213f04eb9b128)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:34.168325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:34.213235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197d3ff34be14da6a84213f04eb9b128'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.220319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197d3ff34be14da6a84213f04eb9b128'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.220996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197d3ff34be14da6a84213f04eb9b128'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.228426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197d3ff34be14da6a84213f04eb9b128'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.240461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197d3ff34be14da6a84213f04eb9b128'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.247223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1175/2355] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:34 2022] DELETE /identity/v3/users/197d3ff34be14da6a84213f04eb9b128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:34.251699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:34.252170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:34.252274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:34.271164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:34.272280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:34.335665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1181/2356] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:34.345425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:34.347910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:34.355197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:34.416777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88c50-7f01-4f86-821b-b45d85d9d3fb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:34.420693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:34.421386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:34.421738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:34.422121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:34.432062 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:34.433643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:34.443416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1176/2357] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:34.717525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:34.719155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:34.732075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e76da-8472-46e7-a096-2cbad0358824 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:34.737767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:34.738443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:34.738733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:34.739000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] PATH_INFO: `/v3/projects/b7d47a781ea2427b81ad99847a099fd2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:34.740352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d47a781ea2427b81ad99847a099fd2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:34.743351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:34.790690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d47a781ea2427b81ad99847a099fd2', 'request_id': 'req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.796600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d47a781ea2427b81ad99847a099fd2', 'request_id': 'req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.804634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d47a781ea2427b81ad99847a099fd2', 'request_id': 'req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.815152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] The token cache is being invalidate because project b7d47a781ea2427b81ad99847a099fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:34.815466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.816093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.817613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1182/2358] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:34 2022] DELETE /identity/v3/projects/b7d47a781ea2427b81ad99847a099fd2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:34.822329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:34.832158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cce043-9aaa-4934-b953-8a7d0848daa0 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:34.889150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:34.889794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:34.890101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:34.890378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] PATH_INFO: `/v3/users/094e4578685649098fa87f478748faa0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:34.891536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094e4578685649098fa87f478748faa0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:34.893447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:34.941421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094e4578685649098fa87f478748faa0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.949511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094e4578685649098fa87f478748faa0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.950151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094e4578685649098fa87f478748faa0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.957312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094e4578685649098fa87f478748faa0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.970365 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094e4578685649098fa87f478748faa0'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:34.977230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1177/2359] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:34 2022] DELETE /identity/v3/users/094e4578685649098fa87f478748faa0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:35.602593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:35.604041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:35.616473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:35.634093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c65b9-ab03-4767-8e51-fdd64ae912fb admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:35.737598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:35.738371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:35.738755 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:35.739104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] PATH_INFO: `/v3/projects/30d89825afce455f9fcc58b6e1f33a12` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:35.740414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d89825afce455f9fcc58b6e1f33a12)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:35.742534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:35.791223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d89825afce455f9fcc58b6e1f33a12', 'request_id': 'req-62c2761a-e270-4807-8542-626de241df20'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.797333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d89825afce455f9fcc58b6e1f33a12', 'request_id': 'req-62c2761a-e270-4807-8542-626de241df20'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.804942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d89825afce455f9fcc58b6e1f33a12', 'request_id': 'req-62c2761a-e270-4807-8542-626de241df20'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.815762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] The token cache is being invalidate because project 30d89825afce455f9fcc58b6e1f33a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:35.815995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.816614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.818169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1183/2360] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:35 2022] DELETE /identity/v3/projects/30d89825afce455f9fcc58b6e1f33a12 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:35.822263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:35.823671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:35.837690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49e47b-8d64-4983-b24d-738863117406 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:35.858263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:35.896718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:35.897355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:35.898157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:35.898436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] PATH_INFO: `/v3/users/328d9d9ddb554285b31656fbb63269b4` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:35.899583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] RBAC: Authorizing `identity:delete_user(user_id=328d9d9ddb554285b31656fbb63269b4)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:35.901483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:35.947398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328d9d9ddb554285b31656fbb63269b4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.954477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328d9d9ddb554285b31656fbb63269b4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.955078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328d9d9ddb554285b31656fbb63269b4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.962820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328d9d9ddb554285b31656fbb63269b4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.974748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7bd68f51-73d7-4464-b8b5-09b7c9bf198d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328d9d9ddb554285b31656fbb63269b4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:35.980922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1178/2361] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:35 2022] DELETE /identity/v3/users/328d9d9ddb554285b31656fbb63269b4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:36.264036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.265618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:36.279147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2761a-e270-4807-8542-626de241df20 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.362307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.363097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.363448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.363768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] PATH_INFO: `/v3/projects/f6d205ddd11741c98a9ee3da0a813625` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.365665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d205ddd11741c98a9ee3da0a813625)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.370284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.426117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:36.440325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d205ddd11741c98a9ee3da0a813625', 'request_id': 'req-bc4af484-700d-4c77-b424-5948f27433d6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:36.449409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d205ddd11741c98a9ee3da0a813625', 'request_id': 'req-bc4af484-700d-4c77-b424-5948f27433d6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:36.457474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d205ddd11741c98a9ee3da0a813625', 'request_id': 'req-bc4af484-700d-4c77-b424-5948f27433d6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:36.469717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] The token cache is being invalidate because project f6d205ddd11741c98a9ee3da0a813625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:36.470105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:36.470832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bc4af484-700d-4c77-b424-5948f27433d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:36.472544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1184/2362] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:36 2022] DELETE /identity/v3/projects/f6d205ddd11741c98a9ee3da0a813625 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:36.479540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f869-b632-4373-839b-6e6456799679 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.479832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f869-b632-4373-839b-6e6456799679 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.480113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f869-b632-4373-839b-6e6456799679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.500570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e708f869-b632-4373-839b-6e6456799679 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:36.501784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e708f869-b632-4373-839b-6e6456799679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:36.564958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1179/2363] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:36.574314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.574627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.574914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.595839 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:36.597227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:36.608041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1185/2364] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:36.612565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f869-b632-4373-839b-6e6456799679 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.623376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f869-b632-4373-839b-6e6456799679 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.627936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.628538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.628815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.629087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.629800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:36.630132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.631702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.644546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1180/2365] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:36.648967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.658301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4b4b-739e-4657-9212-99342334ec8e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.662991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.664259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.664537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.664814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.665515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.667462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.699586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1186/2366] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:36.702270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.713581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721876a-a468-443b-b792-b61325c82e2a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.746739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:36.776870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.777594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.777909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.778188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.778854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.780742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.808149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1181/2367] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:36 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:53:36.812705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.823986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa08d-7663-425a-a065-089d5b723548 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.829418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.830095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.830368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.830648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.831358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.833002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.844864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1187/2368] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:36.848780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.859927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af487-bfe6-4c4b-8244-55c84ed34a15 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.865197 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.865967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.866249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.867074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.867879 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.869464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee3909-6fde-4990-a635-4c640570f713 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.881135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1182/2369] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:36.886331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:36.898124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37b0d-fd44-470f-b6f3-f29b2ce46776 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:36.903530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:36.904208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.904491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.904786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] PATH_INFO: `/v3/projects/aaa8dd1be467477aa2680254349243e9/users/c5acb7c31d714414b82222fbd86d47c7/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.921119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa8dd1be467477aa2680254349243e9, user_id=c5acb7c31d714414b82222fbd86d47c7, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:36.923820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:36.937480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1188/2370] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:36 2022] PUT /identity/v3/projects/aaa8dd1be467477aa2680254349243e9/users/c5acb7c31d714414b82222fbd86d47c7/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:36.949747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:36.950073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:36.950347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:36.978616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] MFA Rules not processed for user `c5acb7c31d714414b82222fbd86d47c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:36.979821 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:37.045163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1183/2371] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:37.056712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:37.058439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:37.113992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08b17-f6a4-4ecd-b19f-4506a1c8c879 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:37.118515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:37.119136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:37.119421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:37.119697 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:37.128208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:37.129639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5240b-2308-496a-aa5c-afa835be3284 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:37.139712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1189/2372] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:41.287078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:41.370801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a82e8-bbc2-42cc-83bf-b93dc6092c4b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:41.375305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:41.375941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:41.376223 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:41.376499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] PATH_INFO: `/v3/users/c5acb7c31d714414b82222fbd86d47c7` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:41.377684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5acb7c31d714414b82222fbd86d47c7)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:41.379645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:41.423252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:41.430323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5acb7c31d714414b82222fbd86d47c7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:41.438628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5acb7c31d714414b82222fbd86d47c7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:41.439249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5acb7c31d714414b82222fbd86d47c7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:41.447818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5acb7c31d714414b82222fbd86d47c7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:41.460759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5acb7c31d714414b82222fbd86d47c7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:41.466855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1184/2373] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:41 2022] DELETE /identity/v3/users/c5acb7c31d714414b82222fbd86d47c7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:41.471480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:41.471976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:41.472080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:41.493307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:41.494949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:41.574046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1190/2374] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:41.581931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:41.583430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:41.653170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e4179-bb8a-4bd0-a7b9-2e3299ba3e51 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:41.658350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:41.658979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:41.659255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:41.660698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:41.683512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:41.685076 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:41.696308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1185/2375] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:41.977162 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:41.978882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:41.986869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:41.995018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40e96b-1aff-4369-b90a-fb70a17b3c2a None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:42.010055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:42.010721 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:42.011007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:42.011287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] PATH_INFO: `/v3/projects/aaa8dd1be467477aa2680254349243e9` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:42.012454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa8dd1be467477aa2680254349243e9)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:42.014426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:42.063361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa8dd1be467477aa2680254349243e9', 'request_id': 'req-833339b5-7b4d-4d39-8b4c-39ffab924048'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:42.069538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa8dd1be467477aa2680254349243e9', 'request_id': 'req-833339b5-7b4d-4d39-8b4c-39ffab924048'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:42.077290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa8dd1be467477aa2680254349243e9', 'request_id': 'req-833339b5-7b4d-4d39-8b4c-39ffab924048'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:42.088669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] The token cache is being invalidate because project aaa8dd1be467477aa2680254349243e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:42.088958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:42.089589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-833339b5-7b4d-4d39-8b4c-39ffab924048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:42.091135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1191/2376] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:41 2022] DELETE /identity/v3/projects/aaa8dd1be467477aa2680254349243e9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:44.988303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:44.989768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.003730 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91942-a26e-4425-b55a-778a6e9127cf service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:45.071487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:45.072139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.072424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.072706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] PATH_INFO: `/v3/users/87613d754dae46229cbc4c52476add5d` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.073995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87613d754dae46229cbc4c52476add5d)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:45.076047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:45.125978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87613d754dae46229cbc4c52476add5d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.134743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87613d754dae46229cbc4c52476add5d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.135379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87613d754dae46229cbc4c52476add5d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.143371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87613d754dae46229cbc4c52476add5d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.144588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:45.157944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87613d754dae46229cbc4c52476add5d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.165009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1186/2377] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:53:44 2022] DELETE /identity/v3/users/87613d754dae46229cbc4c52476add5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:45.169250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.169795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.169795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.190892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:45.192207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.264758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1192/2378] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:45.275775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:45.277359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.346460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a0e13-5ecb-4663-af89-c68db45d6a64 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:45.350230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:45.351635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.352011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.352298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.362473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:45.364576 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3bcbd-7d8d-4b09-88b8-9753808aa35e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:45.374413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1187/2379] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:45.658827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:45.660639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.673981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2cd0-4103-426d-a31e-f15544569e24 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:45.679008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:45.679789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.680076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.680669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] PATH_INFO: `/v3/projects/8ee35c58905e48799f36ac25ea8a0840` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.681627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee35c58905e48799f36ac25ea8a0840)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:45.683568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:45.741185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee35c58905e48799f36ac25ea8a0840', 'request_id': 'req-e25924bc-7c90-4709-9e0a-b759a7b69837'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.748977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee35c58905e48799f36ac25ea8a0840', 'request_id': 'req-e25924bc-7c90-4709-9e0a-b759a7b69837'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.759024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee35c58905e48799f36ac25ea8a0840', 'request_id': 'req-e25924bc-7c90-4709-9e0a-b759a7b69837'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.773549 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] The token cache is being invalidate because project 8ee35c58905e48799f36ac25ea8a0840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:53:45.773753 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.774450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-e25924bc-7c90-4709-9e0a-b759a7b69837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:53:45.777892 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1193/2380] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:53:45 2022] DELETE /identity/v3/projects/8ee35c58905e48799f36ac25ea8a0840 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:53:45.781506 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.781999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.782279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.802655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:45.803846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.895469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1188/2381] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:45.912824 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.913758 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.914146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.934659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:45.935281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:45.943972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1194/2382] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:45.954675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:45.970731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b310cf-f593-461d-8aed-b3e8036be42f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:45.977568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:45.978232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:45.978698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:45.979035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:45.979884 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:53:45.980240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:45.982060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:45.997307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1189/2383] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:53:46.001668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.006120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:46.011636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694603bd-77da-4637-8b05-6cf923281da0 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.017259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.018198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.019008 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.019505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.020365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.031285 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621701f-9157-4bc6-ab0a-ce576fccc6aa admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.072849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1195/2384] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:53:46 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:53:46.076928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.088058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db714d-3eed-4eec-8075-7cd77586732a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.149364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.149998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.150283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.150560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.151260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.153164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.169088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:46.174401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.174876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.174996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.180476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1190/2385] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:53:46 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:53:46.181512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.192473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583b3-a7e5-44af-b0bd-98f5d16b2aa8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.195915 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:46.197150 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:46.197366 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.197921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.198209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.198484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.199181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.200778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.205446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1196/2386] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:46.213427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1191/2387] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:53:46.216690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.226336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.227498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b70b-6a7a-4a2d-a81e-60f361f0d53b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.228099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:46.232232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.232848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.233136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.233414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.234149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.235773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.246690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1197/2388] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:53:46.250747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.260538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab28f1-0b9c-4dba-84ec-0b4af2cf3a2d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.265318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.266015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.266302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.266583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] PATH_INFO: `/v3/projects/9ee87831f83e45e29bb656833c545799/users/f41592a4cef24065ad9f15326edd1ae6/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.282029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee87831f83e45e29bb656833c545799, user_id=f41592a4cef24065ad9f15326edd1ae6, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.284599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81fe5a-ab09-48bc-9e46-82d3c5b94c84 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.298335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1198/2389] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:53:46 2022] PUT /identity/v3/projects/9ee87831f83e45e29bb656833c545799/users/f41592a4cef24065ad9f15326edd1ae6/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 12:53:46.308474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.308767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.309165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.312356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12993-80f6-4bea-8da6-c3084491fc54 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.338957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] MFA Rules not processed for user `f41592a4cef24065ad9f15326edd1ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:46.340186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:46.383201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.383829 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.384117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.384420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.407174 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1199/2390] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:53:46.419798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:46.421175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:46.445975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.447594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa62d1-18e8-478c-91f4-a1aeddc20616 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.457569 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1192/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:46.478989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2e66-1f38-4d25-85f9-9de58fb7a2e5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:46.482679 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:46.483300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:46.483587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:46.483863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:46.492663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:46.494118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6431c8a-155a-45d9-afcf-b46f9db76c01 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:46.502935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1200/2392] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:53:47.120027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:47.120489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:47.120583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:47.140602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] MFA Rules not processed for user `6d0cb8558e0d4cef81b5d740776a1dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:47.141798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:47.154677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:47.197798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1193/2393] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:52.555328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0459-d08d-4546-88d1-86acff96390d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:52.556177 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0459-d08d-4546-88d1-86acff96390d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:52.556796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0459-d08d-4546-88d1-86acff96390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:52.578166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b2ec0459-d08d-4546-88d1-86acff96390d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:52.579493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b2ec0459-d08d-4546-88d1-86acff96390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:52.590566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1201/2394] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:52.613590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:52.615029 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:52.632347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ebc9-70f1-4900-95cd-acb6bb3d0d07 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:52.638103 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:52.638927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:52.639357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:52.639793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:52.652332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:52.654229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:52.667562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1194/2395] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:58.103037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823568b-9a36-4b0b-b9ea-d3106c24e64d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:58.103620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823568b-9a36-4b0b-b9ea-d3106c24e64d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:58.103620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823568b-9a36-4b0b-b9ea-d3106c24e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:58.126168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0823568b-9a36-4b0b-b9ea-d3106c24e64d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:58.127760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0823568b-9a36-4b0b-b9ea-d3106c24e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:58.138046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1202/2396] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:53:58.168698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:53:58.180663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9bb9-d7bd-4099-adb0-80c2f1f33507 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:53:58.187627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:53:58.188474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:58.188825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:58.189171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:58.198434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:53:58.200681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2a47d-a140-4437-a38d-16929aa5e2c7 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:53:58.213125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1195/2397] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:53:59.897801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:53:59.898417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:53:59.898923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:53:59.920510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] MFA Rules not processed for user `a298ec3430b9472e95610154e6d79f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:53:59.921728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:53:59.933943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:59.982930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1203/2398] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:05.059206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3449-07fe-4755-8cd2-9f4329481289 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:05.059701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3449-07fe-4755-8cd2-9f4329481289 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:05.059801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3449-07fe-4755-8cd2-9f4329481289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:05.081797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-920e3449-07fe-4755-8cd2-9f4329481289 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:05.083371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-920e3449-07fe-4755-8cd2-9f4329481289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:05.094113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1196/2399] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:05.120757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:05.135333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a965c-e785-4abe-920f-a76459a45d7c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:05.140829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:05.141488 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:05.141773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:05.142083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:05.151360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:05.152967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:05.164157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1204/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:15.075022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=31 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:15.158584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=23 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:15.419707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c96d7-622c-4321-a76c-df42e1897860 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:15.420052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c96d7-622c-4321-a76c-df42e1897860 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:15.420339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c96d7-622c-4321-a76c-df42e1897860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:15.445341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-410c96d7-622c-4321-a76c-df42e1897860 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:15.446379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-410c96d7-622c-4321-a76c-df42e1897860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:15.454640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1197/2401] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:15.493190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:15.504626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb75651-9da1-4d11-b5ce-813044934593 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:15.511597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:15.512226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:15.512504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:15.512777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:15.523193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:15.524783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:15.534887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1205/2402] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:21.693501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35421-6093-487d-afbc-90846897eab8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:21.694734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35421-6093-487d-afbc-90846897eab8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:21.694734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35421-6093-487d-afbc-90846897eab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:21.718246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1dc35421-6093-487d-afbc-90846897eab8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:21.718246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1dc35421-6093-487d-afbc-90846897eab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:21.728979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1198/2403] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:21.756539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:21.769583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8a74-4f6f-46e0-8da1-aa9c2618c779 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:21.775873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:21.776583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:21.776870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:21.777148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:21.786337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:21.789739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:21.802428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1206/2404] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:23.317376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:23.317852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:23.318641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:23.338240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:23.339489 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:23.399285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1199/2405] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:23.442539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:23.444683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:23.517988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe1a5-4d11-4df1-b222-e32f1145aced service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:23.524382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:23.525009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:23.525298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:23.525720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:23.534133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:23.535804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8705552-4de6-4daf-8fc9-e4d5c0dfda89 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:23.544230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1207/2406] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:54:24.157465 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:24.170727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39707b-c499-4dd8-8779-f495a3fdf766 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:24.176236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:24.176978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:24.177416 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:24.177848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] PATH_INFO: `/v3/users/f41592a4cef24065ad9f15326edd1ae6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:24.179273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41592a4cef24065ad9f15326edd1ae6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:24.181251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:24.239246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41592a4cef24065ad9f15326edd1ae6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:24.249726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41592a4cef24065ad9f15326edd1ae6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:24.250463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41592a4cef24065ad9f15326edd1ae6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:24.259763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41592a4cef24065ad9f15326edd1ae6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:24.273766 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41592a4cef24065ad9f15326edd1ae6'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:24.280696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1200/2407] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:54:24 2022] DELETE /identity/v3/users/f41592a4cef24065ad9f15326edd1ae6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:24.285301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:24.285707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:24.286274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:24.309091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:24.310360 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:24.454234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1208/2408] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:24.468065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:24.470195 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:24.575252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4e30-6836-4173-8311-2130c2489c32 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:24.579985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:24.580670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:24.580938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:24.581373 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:24.593724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:24.595826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c353fe-b011-4372-8822-6499a55fee29 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:24.610914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1201/2409] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:24.941590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:24.945231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:24.973178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a1d82-0dff-4f97-aa35-6ab6572424dc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:24.982647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:24.984212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:24.984748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:24.985533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] PATH_INFO: `/v3/projects/9ee87831f83e45e29bb656833c545799` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:24.987217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee87831f83e45e29bb656833c545799)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:24.989576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.056775 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee87831f83e45e29bb656833c545799', 'request_id': 'req-74582c32-de64-467f-8fc2-2bf33edbc311'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:25.063762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee87831f83e45e29bb656833c545799', 'request_id': 'req-74582c32-de64-467f-8fc2-2bf33edbc311'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:25.068993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:25.074677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee87831f83e45e29bb656833c545799', 'request_id': 'req-74582c32-de64-467f-8fc2-2bf33edbc311'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:25.089580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] The token cache is being invalidate because project 9ee87831f83e45e29bb656833c545799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:54:25.089926 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:25.090623 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-74582c32-de64-467f-8fc2-2bf33edbc311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:25.092280 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1209/2410] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:54:24 2022] DELETE /identity/v3/projects/9ee87831f83e45e29bb656833c545799 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:25.098954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.098954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.098954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.118408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:25.128011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:25.130122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:25.212629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1202/2411] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:25.286083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.286416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.286715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.309574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:25.311265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:25.320763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1210/2412] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:54:25.325139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.336023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351895b-74ff-4aa4-bcb1-c877b4389fdb None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.341184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.342014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.342478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.342762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.343467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:54:25.343775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.345378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.358941 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1203/2413] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:54:25.364833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.375076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc90b3-c247-47c4-827d-22edcf63b9b5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.381056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.381845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.382239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.382900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.383470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.385506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.436528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1211/2414] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:54:25 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:54:25.437778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.456281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6054b-74d8-43fd-8a84-29acc1db7a78 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.531304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.532923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.533376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.533848 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.534701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.537338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.570802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1204/2415] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:54:25 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:54:25.577726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.606586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6841-e4d6-4ecb-94ae-b5fb129ac1c6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.616571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.617827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.618251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.618936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.620333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.622929 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.644556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1212/2416] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:25.645508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.660203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc4a62-02bc-44e2-b5f8-6f57ad1b7948 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.666111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.666969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.667261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.667546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.668257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.669891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16644e66-02c4-41dc-b36c-25db2c09fcd8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.683193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1205/2417] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:25.688746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.703062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e109-3ca1-4987-87f0-834f191c1a54 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:25.708752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:25.709763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.710156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.710443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] PATH_INFO: `/v3/projects/adbc7445f3494955bf0987d231895dd5/users/cf934ce1ab2b412bb9a7da1466a32ac5/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.727495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbc7445f3494955bf0987d231895dd5, user_id=cf934ce1ab2b412bb9a7da1466a32ac5, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:25.730520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:25.747443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1213/2418] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:54:25 2022] PUT /identity/v3/projects/adbc7445f3494955bf0987d231895dd5/users/cf934ce1ab2b412bb9a7da1466a32ac5/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:25.758110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:25.758484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:25.758703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:25.794361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] MFA Rules not processed for user `cf934ce1ab2b412bb9a7da1466a32ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:25.797577 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:25.890274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1206/2419] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:25.904930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:25.907704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:25.995589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e9101-05ca-47d2-b793-93d4d7574e8c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:26.000597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:26.001353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:26.001734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:26.002137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:26.015786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:26.018027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:26.054217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1214/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:35.658892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:35.661545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:35.668758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:35.766505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb5fa3-30d9-4cd0-b5d7-bd7ea7f6ad9b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:35.772967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:35.773964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:35.774327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:35.774868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:35.777007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:35.792585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:35.796283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10baea-0664-47d6-a4b1-f3a5c1f590a4 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:35.808914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1207/2421] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:36.048383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:37.387714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:37.498145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe6a-baf5-47dc-a8a3-49a21908f472 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:37.519925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:37.521038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:37.521543 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:37.522159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] PATH_INFO: `/v3/users/cf934ce1ab2b412bb9a7da1466a32ac5` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:37.523526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf934ce1ab2b412bb9a7da1466a32ac5)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:37.526319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:37.597431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf934ce1ab2b412bb9a7da1466a32ac5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:37.600828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf934ce1ab2b412bb9a7da1466a32ac5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:37.601771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf934ce1ab2b412bb9a7da1466a32ac5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:37.623843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf934ce1ab2b412bb9a7da1466a32ac5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:37.633647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf934ce1ab2b412bb9a7da1466a32ac5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:37.654805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1215/2422] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:54:37 2022] DELETE /identity/v3/users/cf934ce1ab2b412bb9a7da1466a32ac5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:37.656484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ef97-5d99-47d4-a619-1f0424cfae29 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:37.656973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ef97-5d99-47d4-a619-1f0424cfae29 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:37.657055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ef97-5d99-47d4-a619-1f0424cfae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:37.680075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-97e2ef97-5d99-47d4-a619-1f0424cfae29 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:37.682058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-97e2ef97-5d99-47d4-a619-1f0424cfae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:37.800980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1208/2423] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:54:37.813166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:37.815097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:37.904307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28882e2-3b48-459f-a7f8-65bc03b4409f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:37.909034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:37.909675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:37.909990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:37.910267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:37.921143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:37.922617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:37.934365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1216/2424] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:38.336788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c968-0921-4206-9e4c-64e6c9ac60fa None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:38.337764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c968-0921-4206-9e4c-64e6c9ac60fa None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:38.338136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c968-0921-4206-9e4c-64e6c9ac60fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:38.365386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1729c968-0921-4206-9e4c-64e6c9ac60fa None None] MFA Rules not processed for user `8245326bacd0477f81fdfdbd86438fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:38.367264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1729c968-0921-4206-9e4c-64e6c9ac60fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:38.475047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:38.476456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1209/2425] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:38.482210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:38.513109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2876-e1c1-4549-b4c9-7ecdbc7cf50e service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:38.523692 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:38.534763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:38.535418 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:38.535644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] PATH_INFO: `/v3/projects/adbc7445f3494955bf0987d231895dd5` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:38.537187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbc7445f3494955bf0987d231895dd5)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:38.539341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:38.560957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:38.608641 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbc7445f3494955bf0987d231895dd5', 'request_id': 'req-117f7c90-3d84-4948-b0de-b53aee8b9988'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:38.616935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbc7445f3494955bf0987d231895dd5', 'request_id': 'req-117f7c90-3d84-4948-b0de-b53aee8b9988'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:38.626899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbc7445f3494955bf0987d231895dd5', 'request_id': 'req-117f7c90-3d84-4948-b0de-b53aee8b9988'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:38.651759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] The token cache is being invalidate because project adbc7445f3494955bf0987d231895dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:54:38.652084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:38.654355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-117f7c90-3d84-4948-b0de-b53aee8b9988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:38.665873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1217/2426] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:54:38 2022] DELETE /identity/v3/projects/adbc7445f3494955bf0987d231895dd5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:41.253312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:41.253978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:41.253978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:41.288323 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] MFA Rules not processed for user `7268ae80780a4d09967a82f3297dd8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:41.289441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:41.343196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:41.385748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1210/2427] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:54:43.186439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:43.186948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:43.186948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:43.206629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:43.207868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:43.271842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1218/2428] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:43.284174 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:43.285646 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:43.356560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c36e2-cd7f-455d-8ae7-edd4d0226f14 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:43.361724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:43.362374 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:43.362656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:43.362934 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:43.371651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:43.373219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:43.381942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1211/2429] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:54:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:54:45.588262 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:45.589770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:45.659358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a036f-72ff-4a23-92d8-4d8fb309dd72 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:45.664477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:45.665123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:45.665458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:45.665741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] PATH_INFO: `/v3/users/6d0cb8558e0d4cef81b5d740776a1dd6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:45.666997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0cb8558e0d4cef81b5d740776a1dd6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:45.668961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:45.715589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0cb8558e0d4cef81b5d740776a1dd6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:45.716251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0cb8558e0d4cef81b5d740776a1dd6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:45.716864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0cb8558e0d4cef81b5d740776a1dd6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:45.721322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:45.730870 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0cb8558e0d4cef81b5d740776a1dd6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:45.738131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-926d4c2e-13b6-4016-9fc7-763363737fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0cb8558e0d4cef81b5d740776a1dd6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:45.750825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1219/2430] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:54:45 2022] DELETE /identity/v3/users/6d0cb8558e0d4cef81b5d740776a1dd6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:45.923276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:45.936347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70782fd8-ff2a-456f-9649-c228e371baa8 service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:45.993233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:45.993897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:45.994173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:45.994470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] PATH_INFO: `/v3/projects/de31120003234887803959a6fdf5681f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:45.995629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de31120003234887803959a6fdf5681f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:45.997514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.050803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de31120003234887803959a6fdf5681f', 'request_id': 'req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:46.059976 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de31120003234887803959a6fdf5681f', 'request_id': 'req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:46.066421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de31120003234887803959a6fdf5681f', 'request_id': 'req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:46.079759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] The token cache is being invalidate because project de31120003234887803959a6fdf5681f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:54:46.080052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:46.080752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-167e8c5e-13b0-43b4-8a57-4f8b6f413ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:54:46.082439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1212/2431] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:54:45 2022] DELETE /identity/v3/projects/de31120003234887803959a6fdf5681f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:46.088525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.089154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.089530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.113279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:46.115358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:46.178291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1220/2432] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:46.185565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.185881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.186162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.195264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:46.209516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:46.210780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:46.219043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1213/2433] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:46.223297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.233131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fed7dc-8dce-4b3c-b3ef-ca5b433685b5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.238016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.238629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.238913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.239710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.240409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:54:46.240715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.242345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.253683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1221/2434] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 12:54:46.259411 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.268784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7ace6-dde7-4bda-ab88-bb3475d1e176 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.273444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.274081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.274362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.274634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.275298 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.277176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.305138 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1214/2435] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:54:46 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:54:46.309268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.321464 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77566e3-88e9-456a-9488-0c643e7b03e5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.378718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.379346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.379657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.380585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.381277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.383236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.405717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1222/2436] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:54:46 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:54:46.408999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.420199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3173b-764f-4ed6-b3e5-73ac465ae043 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.424870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.425469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.425776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.426087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.427399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.429622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.439954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1215/2437] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:46.443902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.453829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2881-9e11-4442-bf38-ed54f36c959f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.458673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.459273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.459563 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.459840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.460531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.462205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42b5d6-7a0f-4353-bf02-731fd9c4acef admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.476423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1223/2438] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:46.478815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.490368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0073b9-7991-4529-b7e1-952125ed23f0 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.495301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.495965 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.496244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.496518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] PATH_INFO: `/v3/projects/aba2b18892364461bddc2384f1dd1aff/users/9bab53f03bc04866b7cde3391270be89/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.511550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba2b18892364461bddc2384f1dd1aff, user_id=9bab53f03bc04866b7cde3391270be89, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.515132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.531126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1216/2439] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:54:46 2022] PUT /identity/v3/projects/aba2b18892364461bddc2384f1dd1aff/users/9bab53f03bc04866b7cde3391270be89/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:46.536810 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f4b8-8cfe-4cf5-96d9-662bfb12d350 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.537477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f4b8-8cfe-4cf5-96d9-662bfb12d350 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.537477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f4b8-8cfe-4cf5-96d9-662bfb12d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.558890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-6370f4b8-8cfe-4cf5-96d9-662bfb12d350 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:46.560209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-6370f4b8-8cfe-4cf5-96d9-662bfb12d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:46.604662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:46.665821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1224/2440] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:54:46.686487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:46.689276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:46.799559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e893cc-3e64-4ca3-b860-d7c3564d5c43 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:46.805061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:46.805790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:46.806120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:46.806444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:46.841846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:46.846691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:46.859912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1217/2441] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:54:51.966128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:51.966588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:51.966869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:51.999717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] MFA Rules not processed for user `9bab53f03bc04866b7cde3391270be89`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:52.000988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:52.077762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1225/2442] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:52.081904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.093037 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2507df-8729-463f-af78-3856853bc648 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.098158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.099651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.099954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.100240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.100931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.102907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.135710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1218/2443] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:54:52 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:54:52.140328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.154355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0edb-421b-4f12-af9c-ee57da0342cc None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.245136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.246181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.246181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.246414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.247084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.249083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.273974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1226/2444] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:54:52 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:54:52.276948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.288754 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5bcd3-d675-4abd-95b4-12fc33e9e38c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.293574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.294326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.294673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.295012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.295777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.297439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.313768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1219/2445] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:52.315477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.328501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ba3d-71ac-4cf1-84dc-102dd8617f99 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.334554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.336570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.336863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.337145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] PATH_INFO: `/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469/users/73e9ff2cfdec4f0a86fc787737791435/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.355818 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a8fd7bd0924d969c11f4ef4d7a0469, user_id=73e9ff2cfdec4f0a86fc787737791435, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.358539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.373729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1227/2446] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:54:52 2022] PUT /identity/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469/users/73e9ff2cfdec4f0a86fc787737791435/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:52.377763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.390049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7569bf-52ca-4629-8b32-207ea50ef996 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.463761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.464398 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.464685 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.464969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.465729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.467550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758015-1e18-4644-8bd1-9460b22685fb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.478114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1220/2447] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 12:54:52.482399 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:52.493745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367edc6-3ea7-4056-a699-0bc4c6eac745 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:52.498605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:52.499279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:52.499561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:52.499840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] PATH_INFO: `/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469/users/73e9ff2cfdec4f0a86fc787737791435/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:52.501790 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a8fd7bd0924d969c11f4ef4d7a0469, user_id=73e9ff2cfdec4f0a86fc787737791435, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:52.505051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:52.516728 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1228/2448] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:54:52 2022] PUT /identity/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469/users/73e9ff2cfdec4f0a86fc787737791435/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:54:58.678964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85044f3-9225-4397-a0b0-61bd548eb4d0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:58.679931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85044f3-9225-4397-a0b0-61bd548eb4d0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:58.680913 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85044f3-9225-4397-a0b0-61bd548eb4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:58.701093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:58.736804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f85044f3-9225-4397-a0b0-61bd548eb4d0 None None] MFA Rules not processed for user `73e9ff2cfdec4f0a86fc787737791435`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:54:58.738460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f85044f3-9225-4397-a0b0-61bd548eb4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:58.870952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1221/2449] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:54:58.879242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:54:58.882046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:54:58.909606 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:58.985030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0322a-d804-415c-b56b-1677e7af5e2f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:54:58.991140 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:54:58.991913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:54:58.992289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:54:58.992664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:54:59.075852 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:54:59.077518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f065a5-2f05-41fb-a672-f8c9d0c540ac service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:54:59.089631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1229/2450] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:00.311485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:00.312456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:00.312902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:00.341481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] MFA Rules not processed for user `9bab53f03bc04866b7cde3391270be89`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:00.342793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:00.350717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1222/2451] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:01.489714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf628b-320f-4919-b4bd-645250ea390e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:01.490423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf628b-320f-4919-b4bd-645250ea390e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:01.490423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf628b-320f-4919-b4bd-645250ea390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:01.511881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-54bf628b-320f-4919-b4bd-645250ea390e None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:01.513165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-54bf628b-320f-4919-b4bd-645250ea390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:01.583877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1230/2452] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:01.601378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:01.602849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:01.682649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c2761-d525-400e-8c5e-f83c1a0907b6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:01.687672 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:01.688300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:01.688582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:01.688857 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:01.698191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:01.699777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:01.708538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1223/2453] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:55:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:55:03.612205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea7d1-5935-4959-81d5-ba383bbd597b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:03.612846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea7d1-5935-4959-81d5-ba383bbd597b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:03.612846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ea7d1-5935-4959-81d5-ba383bbd597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:03.658337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-3f1ea7d1-5935-4959-81d5-ba383bbd597b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:03.661494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3f1ea7d1-5935-4959-81d5-ba383bbd597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:03.772642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:03.789555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1231/2454] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:03.814705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:03.816387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:03.833671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4661e-5358-4193-946b-6ce3ca3fea4d service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:03.841483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:03.842341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:03.842974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:03.843408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:03.859297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:03.861947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:03.876456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1224/2455] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:07.935455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd90-5dd1-4a95-a5d7-7fbf864314ab None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:07.936046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd90-5dd1-4a95-a5d7-7fbf864314ab None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:07.936484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd90-5dd1-4a95-a5d7-7fbf864314ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:07.958252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a3dfcd90-5dd1-4a95-a5d7-7fbf864314ab None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:07.959604 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a3dfcd90-5dd1-4a95-a5d7-7fbf864314ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:07.967883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1232/2456] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:07.998641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:08.017419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92597-3a17-4b79-9ab9-dd74b3a30de7 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:08.031928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:08.033226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:08.033695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:08.034175 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:08.051814 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:08.053421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:08.065331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1225/2457] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:12.051842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1b8f-8b97-4513-80b5-0929585b78d8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:12.052968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1b8f-8b97-4513-80b5-0929585b78d8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:12.052968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c1b8f-8b97-4513-80b5-0929585b78d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:12.089088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-f79c1b8f-8b97-4513-80b5-0929585b78d8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:12.090459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f79c1b8f-8b97-4513-80b5-0929585b78d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:12.099615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1233/2458] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:12.127854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:12.142014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107fae-be08-45a9-8d66-6b5f2093d609 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:12.149234 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:12.150186 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:12.150625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:12.151110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:12.171448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:12.173319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:12.187744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1226/2459] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 12:55:16.269204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b036ee-7835-46d7-b1b9-b6cb7d6baf9a None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:16.269773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b036ee-7835-46d7-b1b9-b6cb7d6baf9a None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:16.270081 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b036ee-7835-46d7-b1b9-b6cb7d6baf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:16.288737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-64b036ee-7835-46d7-b1b9-b6cb7d6baf9a None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:16.289956 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-64b036ee-7835-46d7-b1b9-b6cb7d6baf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:16.297681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1234/2460] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:16.320824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:16.332676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a62e1-7b80-4b0e-98de-7724479ae5fd service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:16.338131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:16.338732 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:16.339013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:16.339289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:16.347974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:16.349522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992364c-ec2d-48bd-985e-36a7b96fa4d5 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:16.358973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1227/2461] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:21.372651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.373214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.373214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.374631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1235/2462] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:55:21.380624 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827253e-b60d-4adf-8257-5dce4daf9635 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.381121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827253e-b60d-4adf-8257-5dce4daf9635 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.381331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827253e-b60d-4adf-8257-5dce4daf9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.402112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c827253e-b60d-4adf-8257-5dce4daf9635 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:21.403372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c827253e-b60d-4adf-8257-5dce4daf9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:21.413687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1228/2463] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:21.425074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:21.427019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:21.486635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b001297-ec10-4093-ab5c-2e90dceb2e87 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:21.490266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:21.490887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.491171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.491447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.501509 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:21.502979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f52e1-6d4e-4bbc-b6e1-dfa70f2849a1 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:21.513617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1236/2464] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:21.583708 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd7e-977e-41b8-9abd-cc617211ab73 None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.583995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd7e-977e-41b8-9abd-cc617211ab73 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.584302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd7e-977e-41b8-9abd-cc617211ab73 None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.585659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1229/2465] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:55:21.590570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fad1-c1f6-4552-b490-7180700450fd None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.590886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fad1-c1f6-4552-b490-7180700450fd None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.591167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fad1-c1f6-4552-b490-7180700450fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.611975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-89e5fad1-c1f6-4552-b490-7180700450fd None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:21.613607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-89e5fad1-c1f6-4552-b490-7180700450fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:21.666103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1237/2466] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:21.682266 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bbd7e-977e-41b8-9abd-cc617211ab73 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:21.699952 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bbd7e-977e-41b8-9abd-cc617211ab73 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:21.705005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:21.705912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.706269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.707189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.715868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:21.717393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680da5ec-fd3a-4147-9794-00472af5f0f9 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:21.721551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:21.725765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1230/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:21.809198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814693-8e7e-4647-9d66-f4740e536021 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.809493 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814693-8e7e-4647-9d66-f4740e536021 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.809776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814693-8e7e-4647-9d66-f4740e536021 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.811180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1238/2468] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:55:21.817257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f24fa-741b-456f-b4a6-3c2feb84d4f8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.817542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f24fa-741b-456f-b4a6-3c2feb84d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.817835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f24fa-741b-456f-b4a6-3c2feb84d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.840325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-113f24fa-741b-456f-b4a6-3c2feb84d4f8 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:21.841442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-113f24fa-741b-456f-b4a6-3c2feb84d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:21.851518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1231/2469] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:21.862644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32814693-8e7e-4647-9d66-f4740e536021 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:21.874291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32814693-8e7e-4647-9d66-f4740e536021 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:21.877997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:21.878784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:21.879290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:21.879579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:21.890468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:21.892007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:21.905334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1239/2470] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:23.536292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae27f3-da7f-42e4-8060-b4ef5a6b92f2 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:23.536815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae27f3-da7f-42e4-8060-b4ef5a6b92f2 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:23.536815 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae27f3-da7f-42e4-8060-b4ef5a6b92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:23.555900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1fae27f3-da7f-42e4-8060-b4ef5a6b92f2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:23.557090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1fae27f3-da7f-42e4-8060-b4ef5a6b92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:23.564957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1232/2471] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Jul 26 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:23.587717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:23.599687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1be-2ac3-4b95-8bcd-760610573e98 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:23.605314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:23.605954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:23.606245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:23.606527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:23.615322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:23.616891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:23.626378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1240/2472] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:55:29.828340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0895-af91-42b2-9c76-5a661352d602 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:29.828972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0895-af91-42b2-9c76-5a661352d602 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:29.828972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0895-af91-42b2-9c76-5a661352d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:29.860145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d0db0895-af91-42b2-9c76-5a661352d602 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:29.861363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d0db0895-af91-42b2-9c76-5a661352d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:29.870962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1233/2473] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:29.899794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:29.914983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090788-084f-4655-8e22-b53aa3a03c36 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:29.920105 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:29.920723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:29.921200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:29.921482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:29.931815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:29.933391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:29.943694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1241/2474] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:55:39.852119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=9 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:39.939062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=76 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:56.357033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:56.357468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:56.357558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:56.377292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:55:56.378608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:55:56.386183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1234/2475] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:55:56.398762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:55:56.412390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca68de-280b-4d9b-8500-47e9490794b3 service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:55:56.420745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:55:56.421687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:55:56.422157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:55:56.422613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:55:56.432844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:55:56.434473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:55:56.442684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1242/2476] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:56:03.116033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:03.126765 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6946c-0694-429e-9509-8ac1b094d630 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:03.130344 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:03.131504 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:03.132126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:03.132126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:03.144973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:03.147228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:03.159099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1235/2477] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:56:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:56:06.439398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=6 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:13.154333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=9 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:17.963786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:17.965306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:17.979640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83ad1f-1136-47f6-9a08-1e63cb8c9502 service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:17.984240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:17.984879 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:17.985172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:17.985457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] PATH_INFO: `/v3/users/7268ae80780a4d09967a82f3297dd8ed` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:17.986952 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7268ae80780a4d09967a82f3297dd8ed)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:17.988863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:18.035427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7268ae80780a4d09967a82f3297dd8ed'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.036098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7268ae80780a4d09967a82f3297dd8ed'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.037503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7268ae80780a4d09967a82f3297dd8ed'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.049846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7268ae80780a4d09967a82f3297dd8ed'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.057379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-be6a8855-b6da-47f0-93a4-d42c55d51fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7268ae80780a4d09967a82f3297dd8ed'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.071914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1243/2478] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:56:17 2022] DELETE /identity/v3/users/7268ae80780a4d09967a82f3297dd8ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:56:18.248101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:18.261833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23643664-5946-4f25-845b-c29e26b7a00a service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:18.319602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:18.320435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:18.320694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:18.321050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] PATH_INFO: `/v3/projects/12e0c8c80ac645b5bcb5a5b3cd6a44b6` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:18.322247 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e0c8c80ac645b5bcb5a5b3cd6a44b6)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:18.324171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:18.370763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e0c8c80ac645b5bcb5a5b3cd6a44b6', 'request_id': 'req-c839bf0a-d0bb-4616-9d85-08e35268b878'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.377918 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e0c8c80ac645b5bcb5a5b3cd6a44b6', 'request_id': 'req-c839bf0a-d0bb-4616-9d85-08e35268b878'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.383715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e0c8c80ac645b5bcb5a5b3cd6a44b6', 'request_id': 'req-c839bf0a-d0bb-4616-9d85-08e35268b878'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.394714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] The token cache is being invalidate because project 12e0c8c80ac645b5bcb5a5b3cd6a44b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:56:18.395004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.395638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:56:18.397673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1236/2479] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:56:18 2022] DELETE /identity/v3/projects/12e0c8c80ac645b5bcb5a5b3cd6a44b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:56:24.720455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:24.720984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:24.721068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:24.741240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] MFA Rules not processed for user `a298ec3430b9472e95610154e6d79f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:56:24.742480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:24.797953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1244/2480] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:56:27.426994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:27.428602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:27.487081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839bf0a-d0bb-4616-9d85-08e35268b878 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:27.490830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:27.491439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:27.491723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:27.491998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:27.493759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:27.539253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:27.565541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:27.567011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:27.578922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1237/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:56:28.759358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:28.760867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:28.774228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134f28-8e4b-4e56-abed-f41014f1f9a6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:28.777791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:28.778431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:28.778716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:28.778995 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:28.780714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:28.794423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:28.795835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7999adc-0dea-449e-ac4a-e945c0abde2d service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:28.806686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1245/2482] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:56:37.574108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=13 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:38.801976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=60,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:40.377612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:56:40.388048 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b24d1-42f6-4920-b9ff-0c9d9e5f9606 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:56:40.391873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:56:40.392500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:40.392785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:40.393064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:40.394889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:40.454636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:56:40.456070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:56:40.465501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1238/2483] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:56:42.166497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:56:42.166992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:56:42.167115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:56:42.186448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] MFA Rules not processed for user `8245326bacd0477f81fdfdbd86438fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:56:42.187669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:56:42.195124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1246/2484] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:56:50.461431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=28 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:52.180912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:04.388364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:04.389853 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:04.405325 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26187b0-533d-4e19-8122-6945550685fb service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:04.411421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:04.412021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:04.412304 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:04.412578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:04.414271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:04.473290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:04.474899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7917bb-1e4b-4228-8dc2-02810abe79fb service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:04.484768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1239/2485] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:09.259704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:09.274903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6f00-ba25-448c-8e47-80754ef84e04 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:09.281028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:09.281680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:09.282013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:09.282288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:09.285482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:09.300217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:09.302130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:09.315201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1247/2486] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:13.008877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:13.009389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:13.009487 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:13.028839 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] MFA Rules not processed for user `05776e7045fc4e44887cc3cf25e35ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:57:13.030075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:13.037128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1240/2487] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:57:13.343087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:13.352955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b262e19-ad40-4499-9130-7fda4fa44c23 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:13.356505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:13.357142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:13.357428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:13.357706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:13.359471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:13.369711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:13.371155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:13.379352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1248/2488] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:13.692079 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:13.693637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:13.766324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b15e4-2c10-4e02-b632-d9013955bd71 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:13.771794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:13.772408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:13.772692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:13.772967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:13.774724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:13.786677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:13.788255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:13.798036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1241/2489] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:15.699867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:15.709593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d501ef-1bdd-438f-a91d-3c7fa1296759 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:15.713506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:15.714189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:15.714477 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:15.714897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:15.716668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:15.727137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:15.728620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:15.738511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1249/2490] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:22.258058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:22.259555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:22.278063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a386b-ea7a-476e-952b-47f1dff510fe service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:22.283478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:22.284087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:22.284364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:22.284651 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:22.287870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:22.300641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:22.302320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:22.313150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1242/2491] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:25.733396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=18 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:32.308763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=69 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:36.188529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:36.189966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:36.245406 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3874-8757-4689-8ae1-1a42369e91c9 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:36.249045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:36.249662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:36.249989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:36.250268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:36.252001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:36.263321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:36.264778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:36.274382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1250/2492] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:46.269584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=26 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:53.843466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:53.853715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133679c-8f8b-4951-ae4c-09b85560653c service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:53.857541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:53.858210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:53.858492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:53.858763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:53.860630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:53.926469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:53.927962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:53.937836 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1243/2493] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:57.013661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.029848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39760597-e5a7-462c-be8d-f19da4da18ab service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.042809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.043607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.043897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.044175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.046310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:57.061032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.062664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.075638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1251/2494] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:57:57.101889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.103308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:57.116835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a5f90-993b-42c1-a0c1-97e49d4a5a7b service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.122453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.123104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.123387 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.123665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] PATH_INFO: `/v3/users/a298ec3430b9472e95610154e6d79f9d` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.124822 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a298ec3430b9472e95610154e6d79f9d)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.126802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.173399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a298ec3430b9472e95610154e6d79f9d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.181513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a298ec3430b9472e95610154e6d79f9d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.182171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a298ec3430b9472e95610154e6d79f9d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.189217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a298ec3430b9472e95610154e6d79f9d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.201319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-56c48fe0-9259-44da-8c63-d2513509e0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a298ec3430b9472e95610154e6d79f9d'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.207326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1244/2495] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 12:57:57 2022] DELETE /identity/v3/users/a298ec3430b9472e95610154e6d79f9d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:57:57.380568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.391365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8d15-e245-45ab-8741-ceb15944c903 service placement] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.449473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.450163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.450447 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.451224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] PATH_INFO: `/v3/projects/27a83d1592e34bce9d3d68f356206540` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.452467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a83d1592e34bce9d3d68f356206540)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.454414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.502048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a83d1592e34bce9d3d68f356206540', 'request_id': 'req-a2b9e411-3557-4572-98f4-e66534c7be24'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.508761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a83d1592e34bce9d3d68f356206540', 'request_id': 'req-a2b9e411-3557-4572-98f4-e66534c7be24'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.516615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a83d1592e34bce9d3d68f356206540', 'request_id': 'req-a2b9e411-3557-4572-98f4-e66534c7be24'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.529341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] The token cache is being invalidate because project 27a83d1592e34bce9d3d68f356206540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 12:57:57.529657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.530349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a2b9e411-3557-4572-98f4-e66534c7be24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 12:57:57.532090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1252/2496] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 12:57:57 2022] DELETE /identity/v3/projects/27a83d1592e34bce9d3d68f356206540 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:57:57.537771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.538133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.538413 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.558886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:57:57.560222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:57.620855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1245/2497] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:57:57.628833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f544d-43b0-4237-9270-ac695379c671 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.629127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f544d-43b0-4237-9270-ac695379c671 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.629411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f544d-43b0-4237-9270-ac695379c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.650153 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-054f544d-43b0-4237-9270-ac695379c671 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:57:57.651378 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-054f544d-43b0-4237-9270-ac695379c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:57.659374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1253/2498] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:57:57.664370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.674102 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109354-93bb-4ab6-82eb-c2bf386f7b0e None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.678632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.679233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.679515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.679789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.680480 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 12:57:57.680784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.682392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.683837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:57.696260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1246/2499] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 12:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 12:57:57.699928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f544d-43b0-4237-9270-ac695379c671 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.709865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f544d-43b0-4237-9270-ac695379c671 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.714432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.715034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.715313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.715587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.716246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.718257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.745339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1254/2500] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 12:57:57 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 12:57:57.749483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.759609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4439-d3f0-443d-a996-e12bae134b4c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.815710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.816349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.816636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.816916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.817769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.819896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.844560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1247/2501] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 12:57:57 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 12:57:57.845783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.856785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221467d-d679-4e3e-b4c1-2bf01b19f1c2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.861364 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.862005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.862560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.862837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.863526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.865425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.875277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1255/2502] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:57:57.879358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.889733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fe32-02f4-4213-a407-a4aa4ea4c26c admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.894383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.894981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.895264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.895578 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.896968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.898593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89835607-4524-4251-bb09-06724242dd64 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.909225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1248/2503] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 12:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 12:57:57.913337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:57.923764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340fc5-24a9-4ab4-8738-c33c9f1fef76 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:57.928661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:57.929325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.929602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.929920 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] PATH_INFO: `/v3/projects/d0060428cb5d4f9c89471d82aacd392c/users/de93d70b46e6422f8aeb1effc49b02ef/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.945208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0060428cb5d4f9c89471d82aacd392c, user_id=de93d70b46e6422f8aeb1effc49b02ef, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:57.947933 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:57.961356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1256/2504] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 12:57:57 2022] PUT /identity/v3/projects/d0060428cb5d4f9c89471d82aacd392c/users/de93d70b46e6422f8aeb1effc49b02ef/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 12:57:57.966404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d8a-cd2e-43fd-a447-e4778dcb23ec None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:57.966697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d8a-cd2e-43fd-a447-e4778dcb23ec None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:57.966979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d8a-cd2e-43fd-a447-e4778dcb23ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:57.985567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b3e22d8a-cd2e-43fd-a447-e4778dcb23ec None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:57:57.986808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b3e22d8a-cd2e-43fd-a447-e4778dcb23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:58.047177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1249/2505] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:57:58.056710 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:57:58.058407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:57:58.073475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:58.118865 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c33a-2886-4cdf-8917-ae98b38f5cf1 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:57:58.122773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:57:58.123394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:57:58.123680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:57:58.123958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:57:58.133260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:57:58.134720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:57:58.144031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1257/2506] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:58:02.306529 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa89c-07fa-4955-89a3-2bd8927f5844 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:58:02.307005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa89c-07fa-4955-89a3-2bd8927f5844 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:58:02.307133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa89c-07fa-4955-89a3-2bd8927f5844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:58:02.348206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e05aa89c-07fa-4955-89a3-2bd8927f5844 None None] MFA Rules not processed for user `de93d70b46e6422f8aeb1effc49b02ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:58:02.350096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e05aa89c-07fa-4955-89a3-2bd8927f5844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:02.418434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1250/2507] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:58:02.434858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:58:02.436249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:02.529257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f0c04-6b92-408f-94c0-ad35ea1f4902 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:58:02.535032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:58:02.535677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:58:02.535963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:58:02.536287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:58:02.545253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:58:02.546919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:58:02.556997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1258/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:58:03.896244 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a32a7-6181-4fd4-9e9e-e24af9baf56c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:58:03.896747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a32a7-6181-4fd4-9e9e-e24af9baf56c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:58:03.896845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a32a7-6181-4fd4-9e9e-e24af9baf56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:58:03.904011 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:03.918426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ad2a32a7-6181-4fd4-9e9e-e24af9baf56c None None] MFA Rules not processed for user `de93d70b46e6422f8aeb1effc49b02ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:58:03.919649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ad2a32a7-6181-4fd4-9e9e-e24af9baf56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:03.927477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1251/2509] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:58:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:58:04.251029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:58:04.252463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:04.265157 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11dbc-0c97-4910-8dd5-b93199fd8a97 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:58:04.269355 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:58:04.270006 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:58:04.270410 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:58:04.270701 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:58:04.272428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:04.281969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:58:04.283390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31752297-91ef-422a-a6ea-e3bb36dcf91f service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:58:04.291613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1259/2510] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:58:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:58:13.913322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:14.288485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=60 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:22.868181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:58:22.868704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:58:22.868704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:58:22.888093 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] MFA Rules not processed for user `8245326bacd0477f81fdfdbd86438fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:58:22.889283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:58:22.945498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1252/2511] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 12:58:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:58:32.938302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=25 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:07.621724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5a42-e0d6-4e44-b19a-592d74f1b4af None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:07.622271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5a42-e0d6-4e44-b19a-592d74f1b4af None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:07.622374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5a42-e0d6-4e44-b19a-592d74f1b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:07.641947 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-682b5a42-e0d6-4e44-b19a-592d74f1b4af None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:07.643141 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-682b5a42-e0d6-4e44-b19a-592d74f1b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:07.699076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1260/2512] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:59:07.745022 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:07.746453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:07.815157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b3d7c-e26f-4f02-a21d-60495fe99bff None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:07.820799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:07.821403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:07.821683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:07.821989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:07.829850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:07.831428 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d57f3-4376-4971-8c7b-540a9318e9db service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:07.840134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1253/2513] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:17.691314 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=25 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:17.837023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=32 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:21.459661 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.460180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.460389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.461949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1261/2514] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:59:21.468262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd11b4-919c-46b4-a6aa-9c2d9719eac0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.468722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd11b4-919c-46b4-a6aa-9c2d9719eac0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.468835 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd11b4-919c-46b4-a6aa-9c2d9719eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.523851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8ebd11b4-919c-46b4-a6aa-9c2d9719eac0 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:21.525023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8ebd11b4-919c-46b4-a6aa-9c2d9719eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:21.592546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1254/2515] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:59:21.604523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:21.606220 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:21.663437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d3f7-c58c-406e-9198-fc783e483509 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:21.666940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:21.667547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.667829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.668103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.678521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:21.679939 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bdd1d-226d-458b-8c12-1afc7caba823 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:21.690387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1262/2516] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:59:21.760324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1ca63-7a66-4c68-b69d-92dba13a2e3f None None] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.760613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1ca63-7a66-4c68-b69d-92dba13a2e3f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.760888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1ca63-7a66-4c68-b69d-92dba13a2e3f None None] PATH_INFO: `/` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.762284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1255/2517] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:59:21.766903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8530-9b3d-4b00-8abe-583399df59c8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.767190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8530-9b3d-4b00-8abe-583399df59c8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.767462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8530-9b3d-4b00-8abe-583399df59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.788024 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-714f8530-9b3d-4b00-8abe-583399df59c8 None None] MFA Rules not processed for user `d12b699d6f6c4047a4b414e0ccff2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:21.789215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-714f8530-9b3d-4b00-8abe-583399df59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:21.795705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1263/2518] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:59:21.807862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1ca63-7a66-4c68-b69d-92dba13a2e3f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:21.818572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1ca63-7a66-4c68-b69d-92dba13a2e3f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:21.822019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:21.822621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.822894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.823163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.830194 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:21.831550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664721-e89c-4745-a9c2-13a9b38d4dda service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:21.839894 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1256/2519] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:59:21.920858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01722-c4cf-4c7e-ae08-b1b58789066c None None] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.921211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01722-c4cf-4c7e-ae08-b1b58789066c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.921544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01722-c4cf-4c7e-ae08-b1b58789066c None None] PATH_INFO: `/` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.923353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1264/2520] 10.222.0.47 () {54 vars in 921 bytes} [Tue Jul 26 12:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 12:59:21.928661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a5ff-2cd9-4d6c-aace-b32cb24b8a31 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.928943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a5ff-2cd9-4d6c-aace-b32cb24b8a31 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.929213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a5ff-2cd9-4d6c-aace-b32cb24b8a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.948587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3ef9a5ff-2cd9-4d6c-aace-b32cb24b8a31 None None] MFA Rules not processed for user `b9dd08e0da964403bf7d7e2b34669efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:21.949786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3ef9a5ff-2cd9-4d6c-aace-b32cb24b8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:21.959486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1257/2521] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Jul 26 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 12:59:21.969748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01722-c4cf-4c7e-ae08-b1b58789066c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:21.981565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01722-c4cf-4c7e-ae08-b1b58789066c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:21.985125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:21.985749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:21.986061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:21.986336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:21.996630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:21.998074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:22.009232 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1265/2522] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:59:23.753038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06652da-059a-47fe-8e63-f0f47af1ce48 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:23.753527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06652da-059a-47fe-8e63-f0f47af1ce48 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:23.753640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06652da-059a-47fe-8e63-f0f47af1ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:23.783346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-a06652da-059a-47fe-8e63-f0f47af1ce48 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:23.784466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-a06652da-059a-47fe-8e63-f0f47af1ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:23.792661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1258/2523] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:59:23.805201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:23.816275 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5b32-20d3-47ea-bba4-361dd64c9027 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:23.821431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:23.822070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:23.822351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:23.822627 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:23.830840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:23.832394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:23.841059 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1266/2524] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:33.778533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=57 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:33.837932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=41 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:40.998369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:40.998860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:40.998967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:41.018204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 12:59:41.019400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:41.027240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1259/2525] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 12:59:41.040699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:41.051994 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c01a-1978-459b-b735-c32e64de2abe service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:41.057250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:41.057890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:41.058171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:41.058472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:41.067144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:41.068744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:41.076639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1267/2526] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 12:59:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:41.963051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 12:59:41.964414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:42.056339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ddf9-e6f3-4718-afce-f8a5bff31171 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 12:59:42.061446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 12:59:42.062302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 12:59:42.062587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 12:59:42.062892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 12:59:42.064632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 12:59:42.076292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 12:59:42.077867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 12:59:42.088246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1260/2527] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 12:59:51.073491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=6 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:52.083975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=44 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:28.030798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:28.050428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14fe0-711f-490d-9485-37380ac57e38 service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:28.054306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:28.054916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:28.055196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:28.055472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:28.057204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:28.091793 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:28.093211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:28.112086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1268/2528] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:30.884271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:30.895697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c23f-9b07-41e6-8eb5-13342d0947b4 service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:30.903533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:30.904228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:30.904552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:30.904819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:30.906824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:30.925114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:30.927264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:30.945707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1261/2529] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:30.952471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:30.954454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:30.975300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdde064-3cc8-4f76-98b3-d7fe05c278b3 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:30.982254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:30.982913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:30.983210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:30.983469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] PATH_INFO: `/v3/users/8245326bacd0477f81fdfdbd86438fef` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:30.984647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8245326bacd0477f81fdfdbd86438fef)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:30.986716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:31.037874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8245326bacd0477f81fdfdbd86438fef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.038693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8245326bacd0477f81fdfdbd86438fef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.039391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8245326bacd0477f81fdfdbd86438fef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.051411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8245326bacd0477f81fdfdbd86438fef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.058246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6a848ed-19a1-4b0c-b340-2b8914ae6b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8245326bacd0477f81fdfdbd86438fef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.071587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1269/2530] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:30 2022] DELETE /identity/v3/users/8245326bacd0477f81fdfdbd86438fef => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:31.486682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:31.499345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d48b3f-81d6-40a3-8e47-5a5dfb0eab32 service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:31.563972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:31.564625 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.564906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.565188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] PATH_INFO: `/v3/projects/c79c0831e2e349a085ef3c2275e1101f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.566422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79c0831e2e349a085ef3c2275e1101f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:31.568311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:31.618893 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79c0831e2e349a085ef3c2275e1101f', 'request_id': 'req-ca77e048-4166-4348-b4db-a9935c01c999'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.627030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79c0831e2e349a085ef3c2275e1101f', 'request_id': 'req-ca77e048-4166-4348-b4db-a9935c01c999'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.633482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79c0831e2e349a085ef3c2275e1101f', 'request_id': 'req-ca77e048-4166-4348-b4db-a9935c01c999'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.646551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] The token cache is being invalidate because project c79c0831e2e349a085ef3c2275e1101f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:31.647388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.648049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ca77e048-4166-4348-b4db-a9935c01c999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:31.649552 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1262/2531] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:31 2022] DELETE /identity/v3/projects/c79c0831e2e349a085ef3c2275e1101f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:31.654705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.654998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.655279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.702065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:31.703221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:31.754073 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:31.769274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1270/2532] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:31.771993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.772449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.772734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.794227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:31.795441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:31.804241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1263/2533] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:31.808416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:31.818121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6aea-e3a8-4d3a-b7e0-577a2f7c0ea5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:31.822914 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:31.823528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.823815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.824095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.824791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:00:31.825101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:31.826746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:31.838186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1271/2534] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:00:31.842381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:31.853140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f7b66-7f83-4350-af3e-8ce00fdbdc03 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:31.857823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:31.858435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.858720 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.858999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.859661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:31.861678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:31.892201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1264/2535] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:31 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:31.896415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:31.906573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17e0b-ed0e-4e88-b8d0-f99cd6093927 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:31.966358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:31.966993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:31.967171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:31.967450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:31.968125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:31.970066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:31.993000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1272/2536] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:31 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:31.997078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:32.007350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75923b20-71a5-483f-ac57-6268128a5d37 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:32.011872 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:32.012466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:32.012742 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:32.013013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:32.013693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:32.015306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:32.155828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1265/2537] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:32.160065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:32.171356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc667-f991-4460-b2ec-0abcddc5e309 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:32.176267 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:32.176904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:32.177193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:32.177705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:32.178547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:32.180284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57004a6-c98e-4bef-b267-185275a29417 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:32.190873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1273/2538] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:32.195185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:32.205035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e7c3-32da-468f-9edd-39ee9ffd32b0 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:32.210068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:32.210703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:32.210978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:32.211246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] PATH_INFO: `/v3/projects/85f706aefac44dcf98cc424c93482d22/users/69291469ed6e486a82ce7afe4eb9a3c0/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:32.225622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f706aefac44dcf98cc424c93482d22, user_id=69291469ed6e486a82ce7afe4eb9a3c0, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:32.228203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:32.241797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1266/2539] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:32 2022] PUT /identity/v3/projects/85f706aefac44dcf98cc424c93482d22/users/69291469ed6e486a82ce7afe4eb9a3c0/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:32.252248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:32.252539 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:32.252821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:32.281282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] MFA Rules not processed for user `69291469ed6e486a82ce7afe4eb9a3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:32.282536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:32.345347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1274/2540] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:32.356782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:32.358527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:32.377379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:32.439968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1322cc-cbc9-4089-8acf-b15ab0cbede3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:32.443653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:32.444261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:32.444536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:32.444811 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:32.453017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:32.454459 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271109e0-d567-4b38-9341-142bed58f795 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:32.463191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1267/2541] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 13:00:40.830748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:40.888224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:40.894565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6380c-df5f-447b-a584-cbfaac7a51a3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:40.900607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:40.901242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:40.901527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:40.901828 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] PATH_INFO: `/v3/users/69291469ed6e486a82ce7afe4eb9a3c0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:40.902978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=69291469ed6e486a82ce7afe4eb9a3c0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:40.905099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:40.952618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69291469ed6e486a82ce7afe4eb9a3c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:40.953263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69291469ed6e486a82ce7afe4eb9a3c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:40.953888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69291469ed6e486a82ce7afe4eb9a3c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:40.966205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69291469ed6e486a82ce7afe4eb9a3c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:40.973036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69291469ed6e486a82ce7afe4eb9a3c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:40.987572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1275/2542] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:40 2022] DELETE /identity/v3/users/69291469ed6e486a82ce7afe4eb9a3c0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:00:40.993505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:40.994036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:40.994144 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.013349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:41.014583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:41.072951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1268/2543] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:00:41.082652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.084102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:41.153974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc180b1-8ac1-4ec4-8803-b76e450cf4fe admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.157593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.158245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.158535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.158815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.168035 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.169512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadaf20-7f32-488f-aa62-5d3c6a5bc8f7 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.179936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1276/2544] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:41.448748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.450273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:41.464396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2222-722c-4766-b874-aa8bafcf58b0 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.469226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.469983 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.470330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.470668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] PATH_INFO: `/v3/projects/85f706aefac44dcf98cc424c93482d22` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.471897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f706aefac44dcf98cc424c93482d22)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.475109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.522653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f706aefac44dcf98cc424c93482d22', 'request_id': 'req-3274ba72-1ffb-46fc-8541-8357086e1cd7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:41.529350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f706aefac44dcf98cc424c93482d22', 'request_id': 'req-3274ba72-1ffb-46fc-8541-8357086e1cd7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:41.534761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f706aefac44dcf98cc424c93482d22', 'request_id': 'req-3274ba72-1ffb-46fc-8541-8357086e1cd7'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:41.546143 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] The token cache is being invalidate because project 85f706aefac44dcf98cc424c93482d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:41.546425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:41.547036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-3274ba72-1ffb-46fc-8541-8357086e1cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:41.548513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1269/2545] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:41 2022] DELETE /identity/v3/projects/85f706aefac44dcf98cc424c93482d22 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:41.554082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.554398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.554713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.573901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:41.575065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:41.633534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1277/2546] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:41.641478 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.641767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.642082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.661132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:41.663082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:41.670816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1270/2547] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:41.674890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.685190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6affe-7ad5-47bd-bbc1-c29e35613a9b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.689967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.690612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.690894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.691167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.691863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:00:41.692171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.693767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.695300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:41.707027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1278/2548] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 13:00:41.711571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.720588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727148-5481-4c8c-b8da-dc1b39f48a24 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.725717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.726348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.726627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.726901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.727567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.729442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.741086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:41.757664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1271/2549] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:41 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:00:41.761918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.772478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d694f9-d91f-42a2-8641-2deeb2c39432 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.828244 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.828788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.829074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.829353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.830041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.831944 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.853972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1279/2550] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:41 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:41.858046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.868527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabdf78-50fc-46e5-aa10-5216e8a333bb admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.872951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.873542 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.873834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.874120 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.874796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.876360 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.886508 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1272/2551] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:41.890622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.901176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a2e58-6bb5-48d9-a4b0-669a43d09069 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.905770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.906403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.906687 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.906967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.907659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.909236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87c23-d63a-4ece-b231-1bf34d6c5794 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.920266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1280/2552] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:41.924228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:41.934450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e054c7-d074-40bd-98e6-ee583750587d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:41.938981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:41.939605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.939883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.940154 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] PATH_INFO: `/v3/projects/4e6a0115a3e64ae4bef11b46d05a9386/users/789c43dab8c74f7bb19ac85a057abb4a/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:41.954301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6a0115a3e64ae4bef11b46d05a9386, user_id=789c43dab8c74f7bb19ac85a057abb4a, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:41.956902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:41.970437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1273/2553] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:41 2022] PUT /identity/v3/projects/4e6a0115a3e64ae4bef11b46d05a9386/users/789c43dab8c74f7bb19ac85a057abb4a/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:41.982880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:41.983175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:41.983458 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.011938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] MFA Rules not processed for user `789c43dab8c74f7bb19ac85a057abb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:42.013165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:42.077044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1281/2554] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:42.081824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.143871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101cfe4-e411-4215-906a-3876d7a7f08d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.149055 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.149664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.149993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.150276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.150970 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.152851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.180112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1274/2555] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:42 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:42.183975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.195507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e5dfa-a487-4f3d-bfd4-2756843afa5d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.251350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.251998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.252282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.252560 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.253243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.255175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.264407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:42.277423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1282/2556] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:42 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:42.281396 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.292092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887a46-65a4-44c2-9476-b613eb49b562 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.296794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.297418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.297706 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.298010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.298709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.300331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.310381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1275/2557] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:42.314620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.325110 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f45ff-6cb8-46cc-adcb-143125c6f1a0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.329709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.330404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.330691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.330972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] PATH_INFO: `/v3/projects/1ae19871322e4753a90e27df8d063e36/users/3eed312520a34504a2b368ec2db574dd/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.346351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae19871322e4753a90e27df8d063e36, user_id=3eed312520a34504a2b368ec2db574dd, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.348997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.361686 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1283/2558] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:42 2022] PUT /identity/v3/projects/1ae19871322e4753a90e27df8d063e36/users/3eed312520a34504a2b368ec2db574dd/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:42.366061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.375889 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4340-70ef-4a0d-889c-3f4cfe0bc707 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.432377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.432988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.433270 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.433546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.434260 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.435841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe9e37-635f-47ae-bfca-13a80298aeb0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.446161 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1276/2559] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:42.450387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.461483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663d119-3e3e-40b4-91eb-3efb791616e5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.466128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.466785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.467069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.467347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] PATH_INFO: `/v3/projects/1ae19871322e4753a90e27df8d063e36/users/3eed312520a34504a2b368ec2db574dd/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.469288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae19871322e4753a90e27df8d063e36, user_id=3eed312520a34504a2b368ec2db574dd, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.471953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.481884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1284/2560] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:42 2022] PUT /identity/v3/projects/1ae19871322e4753a90e27df8d063e36/users/3eed312520a34504a2b368ec2db574dd/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:42.492826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.493441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.493851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.522069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] MFA Rules not processed for user `3eed312520a34504a2b368ec2db574dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:42.523278 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:42.535917 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:42.590696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1277/2561] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:42.602038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:42.603754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:42.661079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101ed9-7a76-4b6c-877b-b9c4634e6d83 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:42.665294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:42.665922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:42.666208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:42.666482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:42.675356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:42.676780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ac1b7-4bbf-49ab-80d7-28c5e7c52b82 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:42.686099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1285/2562] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:43.099014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:43.160768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2acfea-b34a-4f88-8991-29616a9cb6b5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:43.165559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:43.166271 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:43.166561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:43.166945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] PATH_INFO: `/v3/users/789c43dab8c74f7bb19ac85a057abb4a` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:43.168002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=789c43dab8c74f7bb19ac85a057abb4a)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:43.170017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:43.223621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789c43dab8c74f7bb19ac85a057abb4a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.230782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789c43dab8c74f7bb19ac85a057abb4a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.231364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789c43dab8c74f7bb19ac85a057abb4a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.238182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789c43dab8c74f7bb19ac85a057abb4a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.250684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789c43dab8c74f7bb19ac85a057abb4a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.257258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1278/2563] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:43 2022] DELETE /identity/v3/users/789c43dab8c74f7bb19ac85a057abb4a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:00:43.261715 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:43.262301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:43.262436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:43.281462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:43.282738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:43.342437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1286/2564] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:43.352236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:43.353607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:43.388147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:43.412824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e988-8e01-44ef-82f1-f1086c1b99cc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:43.416445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:43.417042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:43.417321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:43.417592 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:43.426425 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:43.428388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:43.437995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1279/2565] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:43.706375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:43.707787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:43.727085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1479d-5a79-4e3c-91eb-a23053f425b3 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:43.733407 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:43.734088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:43.734370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:43.734644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] PATH_INFO: `/v3/projects/4e6a0115a3e64ae4bef11b46d05a9386` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:43.735874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6a0115a3e64ae4bef11b46d05a9386)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:43.737783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:43.784825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6a0115a3e64ae4bef11b46d05a9386', 'request_id': 'req-dbf9e61c-640a-412e-aa8d-5a4d009add9b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.787205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:43.792520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6a0115a3e64ae4bef11b46d05a9386', 'request_id': 'req-dbf9e61c-640a-412e-aa8d-5a4d009add9b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.800202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6a0115a3e64ae4bef11b46d05a9386', 'request_id': 'req-dbf9e61c-640a-412e-aa8d-5a4d009add9b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.811545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] The token cache is being invalidate because project 4e6a0115a3e64ae4bef11b46d05a9386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:43.811831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.812451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.813982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1287/2566] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:43 2022] DELETE /identity/v3/projects/4e6a0115a3e64ae4bef11b46d05a9386 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:43.818084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:43.827859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9999aef-146b-40fa-a68a-6154cb1b5510 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:43.883545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:43.884181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:43.884461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:43.884737 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] PATH_INFO: `/v3/users/3eed312520a34504a2b368ec2db574dd` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:43.885915 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eed312520a34504a2b368ec2db574dd)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:43.887818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:43.933780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eed312520a34504a2b368ec2db574dd'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.941219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eed312520a34504a2b368ec2db574dd'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.941850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eed312520a34504a2b368ec2db574dd'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.948776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eed312520a34504a2b368ec2db574dd'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.960973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-92d641fb-4a6f-4f75-a202-1d8119cdb6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eed312520a34504a2b368ec2db574dd'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:43.966808 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1280/2567] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:43 2022] DELETE /identity/v3/users/3eed312520a34504a2b368ec2db574dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:44.242497 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.244000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:44.259695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e61c-640a-412e-aa8d-5a4d009add9b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.319210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.319893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.320117 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.320390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] PATH_INFO: `/v3/projects/1ae19871322e4753a90e27df8d063e36` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.321535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae19871322e4753a90e27df8d063e36)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.323468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.370101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae19871322e4753a90e27df8d063e36', 'request_id': 'req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:44.376132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae19871322e4753a90e27df8d063e36', 'request_id': 'req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:44.383540 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae19871322e4753a90e27df8d063e36', 'request_id': 'req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:44.394045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] The token cache is being invalidate because project 1ae19871322e4753a90e27df8d063e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:44.394336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:44.394969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c1a428d1-63c1-4b13-b1a9-2b0c9c303501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:44.397058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1288/2568] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:44 2022] DELETE /identity/v3/projects/1ae19871322e4753a90e27df8d063e36 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:44.403221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.403748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.403863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.423237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:44.424436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:44.471181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:44.485330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1281/2569] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:44.493782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.494107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.494390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.514427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:44.515634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:44.524288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1289/2570] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:44.528417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.538216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476549ef-94c1-4a3a-836a-19523eff6afd None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.542756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.543355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.543638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.543916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.544610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:00:44.544916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.546540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.558389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1282/2571] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:00:44.562518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.572331 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f29e-528e-4df5-8cd9-cc2e20aed728 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.577172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.577786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.578101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.578379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.579102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.580985 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.608109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1290/2572] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:44.612180 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.622581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1c02-840c-418b-a7dd-238ec50b48cf admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.679068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.679671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.679956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.680224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.680870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.682787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.703862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1283/2573] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:44.707984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.719097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ae8a-29aa-4035-a8c3-57d868bc6a11 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.723795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.724745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.725041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.725324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.726065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.727658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.737520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1291/2574] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:44.742123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.751794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135a3a7-b3bc-47b8-8643-23447c34f649 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.756993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.757603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.757912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.758189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.758870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.760424 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b92d46-5a10-45c3-92f5-2353635419d4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.770617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1284/2575] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:44.774567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.784393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c15975-f47e-49c1-ac8d-58bf00606094 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:44.789051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:44.789712 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.790044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.790317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] PATH_INFO: `/v3/projects/e4006b92915d401b9243e715b19cfc3f/users/6cae5d891c33443394d6b67f92bf2ca8/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.805101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4006b92915d401b9243e715b19cfc3f, user_id=6cae5d891c33443394d6b67f92bf2ca8, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:44.807765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:44.821132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1292/2576] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:44 2022] PUT /identity/v3/projects/e4006b92915d401b9243e715b19cfc3f/users/6cae5d891c33443394d6b67f92bf2ca8/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:00:44.832187 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:44.832472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:44.832745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:44.867146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] MFA Rules not processed for user `6cae5d891c33443394d6b67f92bf2ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:44.868329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:44.932426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1285/2577] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:44.936834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:44.946650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:45.000757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248658fd-0a5e-4e98-86d0-4d8a9caf1ce7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.005316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.006680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.006957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.007226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.007886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.009749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.036960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1293/2578] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:44 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:45.040739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.051701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce9d9-60f0-461a-9493-4cbe698f5a8c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.096157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:45.109755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.110392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.110670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.110943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.111603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.113791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.134541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1286/2579] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:45 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:00:45.138532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.149079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490669ed-06dd-43c6-8985-34233510d6e9 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.153749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.154751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.154751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.154931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.155630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.157225 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.168322 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1294/2580] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:45.172395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.183134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a83f-0572-4218-817d-1d9eb42f81d1 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.187635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.188280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.188559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.188831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] PATH_INFO: `/v3/projects/ffecded20a434624b644e5b3d614d4a2/users/850a974defe34412b334e337f2344b2a/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.203402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffecded20a434624b644e5b3d614d4a2, user_id=850a974defe34412b334e337f2344b2a, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.206183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.218768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1287/2581] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:45 2022] PUT /identity/v3/projects/ffecded20a434624b644e5b3d614d4a2/users/850a974defe34412b334e337f2344b2a/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:45.222618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.232887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae546-2e5d-41a5-99bb-eca6461516f6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.288588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.289129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.289417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.289693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.290415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.291992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087f93-c97f-4dfb-ac68-1888c1d8cdc3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.303324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1295/2582] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:45.307938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.318115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0063da-9bf1-4e12-b275-b5d92b44fe06 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.323255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.323912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.324224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.324629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] PATH_INFO: `/v3/projects/ffecded20a434624b644e5b3d614d4a2/users/850a974defe34412b334e337f2344b2a/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.326785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffecded20a434624b644e5b3d614d4a2, user_id=850a974defe34412b334e337f2344b2a, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.329635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.340776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1288/2583] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:45 2022] PUT /identity/v3/projects/ffecded20a434624b644e5b3d614d4a2/users/850a974defe34412b334e337f2344b2a/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:45.352014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.352512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.352622 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.380187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] MFA Rules not processed for user `850a974defe34412b334e337f2344b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:45.381397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:45.447542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1296/2584] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:45.458124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.460440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:45.517644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469db0ce-e447-4d6b-ab86-4c64462ab7ff admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:45.521883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:45.522498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:45.522784 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:45.523060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:45.532129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:45.533545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7066724-2775-44ce-85d3-7a6b150fd616 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:45.543510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1289/2585] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:45.938655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:45.943524 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:46.002542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8337e7-2aff-43b9-9035-93ef9197e380 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:46.007820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:46.008461 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:46.008746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:46.009026 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] PATH_INFO: `/v3/users/6cae5d891c33443394d6b67f92bf2ca8` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:46.010217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cae5d891c33443394d6b67f92bf2ca8)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:46.012180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:46.060042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cae5d891c33443394d6b67f92bf2ca8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.060664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cae5d891c33443394d6b67f92bf2ca8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.061271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cae5d891c33443394d6b67f92bf2ca8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.073592 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cae5d891c33443394d6b67f92bf2ca8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.080394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cae5d891c33443394d6b67f92bf2ca8'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.094062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1297/2586] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:45 2022] DELETE /identity/v3/users/6cae5d891c33443394d6b67f92bf2ca8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:46.098600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:46.098921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:46.099204 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:46.117634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:46.118856 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:46.176975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1290/2587] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:46.186649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:46.188060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:46.248202 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9825b-7631-419f-83e8-aef07448ac97 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:46.251968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:46.252597 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:46.252881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:46.253158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:46.263134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:46.264562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:46.274276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1298/2588] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 13:00:46.539599 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:46.541146 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:46.554491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a6691-9955-40ff-9936-d72f063b180c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:46.559273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:46.559944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:46.560227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:46.560556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] PATH_INFO: `/v3/projects/e4006b92915d401b9243e715b19cfc3f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:46.561783 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4006b92915d401b9243e715b19cfc3f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:46.563738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:46.605522 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:46.616046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4006b92915d401b9243e715b19cfc3f', 'request_id': 'req-1a8aded7-7d64-4148-a71c-6757e6a48d25'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.623421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4006b92915d401b9243e715b19cfc3f', 'request_id': 'req-1a8aded7-7d64-4148-a71c-6757e6a48d25'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.629217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4006b92915d401b9243e715b19cfc3f', 'request_id': 'req-1a8aded7-7d64-4148-a71c-6757e6a48d25'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.640519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] The token cache is being invalidate because project e4006b92915d401b9243e715b19cfc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:46.640802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.641450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.642993 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1291/2589] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:46 2022] DELETE /identity/v3/projects/e4006b92915d401b9243e715b19cfc3f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:46.647014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:46.656401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eadea-d27c-499a-811c-4dc5ea68a556 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:46.675834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:46.714422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:46.715061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:46.715351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:46.715626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] PATH_INFO: `/v3/users/850a974defe34412b334e337f2344b2a` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:46.716787 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=850a974defe34412b334e337f2344b2a)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:46.718781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:46.766583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850a974defe34412b334e337f2344b2a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.767243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850a974defe34412b334e337f2344b2a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.767851 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850a974defe34412b334e337f2344b2a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.779669 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850a974defe34412b334e337f2344b2a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.787124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c0056a6c-beb1-43bc-8cc7-6e2ec90bdb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850a974defe34412b334e337f2344b2a'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:46.799993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1299/2590] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:00:46 2022] DELETE /identity/v3/users/850a974defe34412b334e337f2344b2a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:47.068162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.069656 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:47.082639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aded7-7d64-4148-a71c-6757e6a48d25 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.140007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.140574 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.140862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.141137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] PATH_INFO: `/v3/projects/ffecded20a434624b644e5b3d614d4a2` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.142314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffecded20a434624b644e5b3d614d4a2)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.144205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.189650 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffecded20a434624b644e5b3d614d4a2', 'request_id': 'req-5a672df4-74c3-4a02-aa16-53d7933139ea'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:47.197454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffecded20a434624b644e5b3d614d4a2', 'request_id': 'req-5a672df4-74c3-4a02-aa16-53d7933139ea'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:47.203069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffecded20a434624b644e5b3d614d4a2', 'request_id': 'req-5a672df4-74c3-4a02-aa16-53d7933139ea'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:47.214538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] The token cache is being invalidate because project ffecded20a434624b644e5b3d614d4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:00:47.214826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:47.215449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5a672df4-74c3-4a02-aa16-53d7933139ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:00:47.216937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1292/2591] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:00:47 2022] DELETE /identity/v3/projects/ffecded20a434624b644e5b3d614d4a2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:47.221931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.222234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.222520 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.242917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:47.244127 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:47.310049 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1300/2592] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:47.319205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.319493 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.319768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.339535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:47.340735 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:47.348747 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1293/2593] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:47.353423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.363158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057da6f-28b7-4ee9-ace8-86e384f43cb6 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.368107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.368716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.369000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.369277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.370007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:00:47.370320 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.371908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.383837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1301/2594] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:00:47.387960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.397969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc6b1-8f54-4594-8b7f-79a5f568fced None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.402498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.403086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.403362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.403634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.404282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.406177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.435248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1294/2595] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:00:47 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:47.439515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.450038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd00a-b05d-4117-825f-26bb2b44a724 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.479168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:47.508871 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.509490 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.509777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.510083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.510748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.512670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.533316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1302/2596] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:00:47 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:00:47.537688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.547800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8964-f68a-42cc-a26d-3813d75b8c3e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.552283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.552875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.553184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.553451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.554166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.555725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.565588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1295/2597] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:47.570245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.580203 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf9fa6-3041-4be8-a308-d667021cbbc0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.585470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.586106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.586394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.586673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.587371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.588953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c75fe7-64b2-438f-8665-f58931267e8a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.599369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1303/2598] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:00:47.603354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.613203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734322-35ad-41d9-b839-f14f01c85d20 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.618101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.618748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.619031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.619309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] PATH_INFO: `/v3/projects/8db3bffd77804c04873e082c004aa59c/users/1cc47fed5674474190369b41d188fb42/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.634437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db3bffd77804c04873e082c004aa59c, user_id=1cc47fed5674474190369b41d188fb42, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.637069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.639281 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:47.652609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1296/2599] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:00:47 2022] PUT /identity/v3/projects/8db3bffd77804c04873e082c004aa59c/users/1cc47fed5674474190369b41d188fb42/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:00:47.662652 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.663130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.663230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.690210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] MFA Rules not processed for user `1cc47fed5674474190369b41d188fb42`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:00:47.691421 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:47.756891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1304/2600] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:00:47.768963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:47.770638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:47.828335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d464-84c3-4620-8d91-25495cd87f24 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:47.831949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:47.832551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:47.832830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:47.833105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:47.841431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:47.842892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:47.851860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1297/2601] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:54.009736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:54.011181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:54.070420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279eef-24ab-4d81-8bb7-e2e9e3afa0f8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:54.074043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:54.074665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:54.074949 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:54.075227 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:54.076977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:54.134655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:54.139550 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:54.141308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:54.150663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1305/2602] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:55.014887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:55.016477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:55.106867 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b03f-2872-437d-95e3-463e82eba249 service glance] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:55.113963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:55.114704 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:55.116394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:55.116394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:55.118047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:55.131446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:55.133316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:55.146109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1298/2603] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:00:58.980642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:00:58.989999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfedc5-1e76-4db6-abba-990a9ba0c7c3 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:00:58.993657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:00:58.994308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:00:58.994601 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:00:58.994882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:00:58.996663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:00:59.063366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:00:59.064814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:00:59.075919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1306/2604] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:05.140714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:INSERT=1,keystone:SELECT=62 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:05.489745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:05.492626 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:05.507757 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f2e-3483-4cff-8058-ca58bcaf8340 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:05.512404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:05.513332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:05.513654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:05.514007 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] PATH_INFO: `/v3/users/9bab53f03bc04866b7cde3391270be89` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:05.515402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bab53f03bc04866b7cde3391270be89)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:05.517303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:05.567355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bab53f03bc04866b7cde3391270be89'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.575112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bab53f03bc04866b7cde3391270be89'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.575738 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bab53f03bc04866b7cde3391270be89'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.582906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bab53f03bc04866b7cde3391270be89'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.594767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bab53f03bc04866b7cde3391270be89'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.602286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1299/2605] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:01:05 2022] DELETE /identity/v3/users/9bab53f03bc04866b7cde3391270be89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:05.779845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:05.791962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a28b-213b-49bd-a21f-c65ab3a7cbd8 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:05.853398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:05.854064 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:05.854346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:05.854629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] PATH_INFO: `/v3/projects/aba2b18892364461bddc2384f1dd1aff` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:05.855792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba2b18892364461bddc2384f1dd1aff)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:05.857705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:05.902129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba2b18892364461bddc2384f1dd1aff', 'request_id': 'req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.908053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba2b18892364461bddc2384f1dd1aff', 'request_id': 'req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.916598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba2b18892364461bddc2384f1dd1aff', 'request_id': 'req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.927085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] The token cache is being invalidate because project aba2b18892364461bddc2384f1dd1aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:01:05.927380 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.928151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:05.929698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1307/2606] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:01:05 2022] DELETE /identity/v3/projects/aba2b18892364461bddc2384f1dd1aff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:05.934129 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:05.935556 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:05.948670 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd03b-456c-47dd-bc53-309162ae9653 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:06.004714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:06.005268 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:06.005548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:06.005834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] PATH_INFO: `/v3/users/73e9ff2cfdec4f0a86fc787737791435` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:06.007145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e9ff2cfdec4f0a86fc787737791435)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:06.009028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:06.055200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e9ff2cfdec4f0a86fc787737791435'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.062248 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e9ff2cfdec4f0a86fc787737791435'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.062864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e9ff2cfdec4f0a86fc787737791435'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.070466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e9ff2cfdec4f0a86fc787737791435'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.078301 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:06.083440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e9ff2cfdec4f0a86fc787737791435'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.091054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1300/2607] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:01:05 2022] DELETE /identity/v3/users/73e9ff2cfdec4f0a86fc787737791435 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:06.270308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:06.272400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:06.286724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4fa5-d72e-41b3-b917-d0802b382a1b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:06.302332 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:06.355936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:06.356617 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:06.356903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:06.357180 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] PATH_INFO: `/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:06.358385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a8fd7bd0924d969c11f4ef4d7a0469)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:06.361137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:06.408937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a8fd7bd0924d969c11f4ef4d7a0469', 'request_id': 'req-83f0db0d-1dbb-4383-b167-f1f69de567a6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.415541 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a8fd7bd0924d969c11f4ef4d7a0469', 'request_id': 'req-83f0db0d-1dbb-4383-b167-f1f69de567a6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.423798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a8fd7bd0924d969c11f4ef4d7a0469', 'request_id': 'req-83f0db0d-1dbb-4383-b167-f1f69de567a6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.435207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] The token cache is being invalidate because project f5a8fd7bd0924d969c11f4ef4d7a0469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:01:06.435498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.436133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-83f0db0d-1dbb-4383-b167-f1f69de567a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:06.437629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1308/2608] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:01:06 2022] DELETE /identity/v3/projects/f5a8fd7bd0924d969c11f4ef4d7a0469 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:16.089275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:16.433080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:17.043586 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:17.044989 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.057719 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38f2b-cad2-4dad-9faf-c3530598751b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:17.116551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:17.117196 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.117453 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.117724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] PATH_INFO: `/v3/users/1cc47fed5674474190369b41d188fb42` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.119015 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc47fed5674474190369b41d188fb42)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:17.120907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:17.170176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc47fed5674474190369b41d188fb42'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.177615 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc47fed5674474190369b41d188fb42'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.178264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc47fed5674474190369b41d188fb42'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.185579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc47fed5674474190369b41d188fb42'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.198804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc47fed5674474190369b41d188fb42'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.205123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1301/2609] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:01:17 2022] DELETE /identity/v3/users/1cc47fed5674474190369b41d188fb42 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:17.209091 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.209383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.209663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.230846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:17.231831 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.301318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1309/2610] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:17.312483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:17.313973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.374513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e57aaf-3c8b-4acf-9f48-8bb27f7f5c1d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:17.378261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:17.378871 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.379152 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.379430 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.389169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:17.390613 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83f817-69ee-46b5-b3f6-d802521239fa service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:17.400647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1302/2611] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:17.670205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:17.671678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.685450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ac2ef-c78b-407e-8d39-9bd56b998d2c None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:17.690282 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:17.690940 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.691219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.691529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] PATH_INFO: `/v3/projects/8db3bffd77804c04873e082c004aa59c` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.692704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db3bffd77804c04873e082c004aa59c)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:17.694666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:17.741729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db3bffd77804c04873e082c004aa59c', 'request_id': 'req-d3842b7b-d6c2-4698-913f-8cd0776b5198'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.748510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db3bffd77804c04873e082c004aa59c', 'request_id': 'req-d3842b7b-d6c2-4698-913f-8cd0776b5198'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.755738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db3bffd77804c04873e082c004aa59c', 'request_id': 'req-d3842b7b-d6c2-4698-913f-8cd0776b5198'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.767042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] The token cache is being invalidate because project 8db3bffd77804c04873e082c004aa59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:01:17.767333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.767966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-d3842b7b-d6c2-4698-913f-8cd0776b5198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:17.769466 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1310/2612] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:01:17 2022] DELETE /identity/v3/projects/8db3bffd77804c04873e082c004aa59c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:17.774881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.775242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.775621 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.795313 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:17.796546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.815172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:17.859684 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1303/2613] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:17.869849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.870287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.870577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.892504 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:17.893700 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:17.902139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1311/2614] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:17.906457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:17.917131 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea389e2-182a-44eb-adda-b299748b7a79 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:17.921745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:17.922376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.922653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.922926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.923630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:01:17.923914 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:17.925936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:17.939919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1304/2615] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:01:17.944306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:17.954512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87287d-556e-4a5c-9431-9e658d99a998 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:17.959260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:17.959883 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:17.960171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:17.960525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:17.961119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:17.963106 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:17.994814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1312/2616] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:01:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:01:17.995977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:18.006405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e52c05-3626-409c-8c0e-a55a023b3638 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:18.066147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:18.066692 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.066972 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.067263 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.067938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:18.069861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:18.090967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1305/2617] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:01:17 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:01:18.095093 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:18.106240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2afbe-fc28-4c40-9c60-d7a62f38eb3d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:18.110923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:18.111534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.111822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.112103 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.112834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:18.114719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:18.125263 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1313/2618] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:01:18.129139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:18.139226 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4424ad-8112-4f62-b0a1-be15577b15dd admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:18.143789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:18.144385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.144671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.144947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.145637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:18.147242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bbf9-d72c-4921-b5f5-c8c6495cf78c admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:18.157906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1306/2619] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:01:18.161978 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:18.172545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192fab-1d83-445e-bd3c-9bce1c48716a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:18.177191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:18.177866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.178154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.178438 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] PATH_INFO: `/v3/projects/5f3a8d91effb499081c9943815b29d3b/users/22d6397c92094e0f981587b0d0d5ce6d/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.193341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a8d91effb499081c9943815b29d3b, user_id=22d6397c92094e0f981587b0d0d5ce6d, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:18.196019 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:18.208811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1314/2620] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:01:18 2022] PUT /identity/v3/projects/5f3a8d91effb499081c9943815b29d3b/users/22d6397c92094e0f981587b0d0d5ce6d/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:18.219137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bcdb-6c04-402e-ba47-f96b181f7ec0 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.219423 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bcdb-6c04-402e-ba47-f96b181f7ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.219725 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bcdb-6c04-402e-ba47-f96b181f7ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.248491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-14e9bcdb-6c04-402e-ba47-f96b181f7ec0 None None] MFA Rules not processed for user `22d6397c92094e0f981587b0d0d5ce6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:18.249691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-14e9bcdb-6c04-402e-ba47-f96b181f7ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:18.313925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1307/2621] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:18.324873 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:18.326748 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:18.348353 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:18.388729 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329c44-1335-41c7-bbe1-599107a03fe8 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:18.392580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:18.393204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:18.393486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:18.393762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:18.403923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:18.405389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:18.414229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1315/2622] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:19.793199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:19.793726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:19.793726 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:19.813476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] MFA Rules not processed for user `22d6397c92094e0f981587b0d0d5ce6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:19.814713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:19.821865 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1308/2623] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:27.072199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:27.073610 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:27.129213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9556c-1865-443a-9b22-41838d9b1c54 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:27.132732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:27.133339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:27.133643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:27.134016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:27.135699 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:27.213740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:27.215210 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf506cd-2bd3-4540-9ec0-19b1631274ec service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:27.233476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1316/2624] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:28.408198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:28.409658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:28.422119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808486-929a-438f-b3d0-c81d57ee8751 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:28.425817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:28.426507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:28.426861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:28.427211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:28.428937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:28.443331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:28.444758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:28.450507 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:28.459090 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1309/2625] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:01:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:33.451963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0883-f72a-48c4-a056-099c020bc6eb None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:33.452450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0883-f72a-48c4-a056-099c020bc6eb None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:33.452798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb0883-f72a-48c4-a056-099c020bc6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:33.473515 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-97cb0883-f72a-48c4-a056-099c020bc6eb None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:33.474804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-97cb0883-f72a-48c4-a056-099c020bc6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:33.533301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1317/2626] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:33.578981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:33.580385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:33.649106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377675f5-c471-4600-b2af-4e41bccf46e6 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:33.654343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:33.654954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:33.655236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:33.655509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:33.663530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:33.665105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:33.673065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1310/2627] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:34.180259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85bc7-14b1-486c-a7da-12308a2102cf None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.180562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85bc7-14b1-486c-a7da-12308a2102cf None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.180913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85bc7-14b1-486c-a7da-12308a2102cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.200201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-fed85bc7-14b1-486c-a7da-12308a2102cf None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:34.201396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fed85bc7-14b1-486c-a7da-12308a2102cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:34.208553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1318/2628] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:01:34.221433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:34.233140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740dbb6-fdde-489f-bb2b-cc9eaa6c0ca3 service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:34.238341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:34.239220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.239498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.239791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.248034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:34.249588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:34.257789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1311/2629] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:34.477054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79fb-0892-412e-8ba7-d87234f67ac6 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.477670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79fb-0892-412e-8ba7-d87234f67ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.478366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79fb-0892-412e-8ba7-d87234f67ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.486744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:34.500115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1add79fb-0892-412e-8ba7-d87234f67ac6 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:34.501325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1add79fb-0892-412e-8ba7-d87234f67ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:34.509394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1319/2630] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:34.521971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:34.533408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab6407-4dee-4b44-ab8b-63c36fa76eea service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:34.538870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:34.539394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.539597 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.539870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.555229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:34.557417 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:34.567749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1312/2631] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:34.913167 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.913398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.913681 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.933204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:34.934505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:34.942184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1320/2632] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:34.954771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:34.965620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cab308-288a-45a3-970a-76453499c4a3 service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:34.970602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:34.971228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:34.971513 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:34.971790 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:34.979716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:34.981280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36fa2c-d316-43dd-90e2-b74a9ebb9add service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:34.989437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1313/2633] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:37.175094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:37.237653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3fe2a-5497-4cf7-9d5b-b97cc23c0e04 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:37.242347 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:37.242979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:37.243826 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:37.244104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] PATH_INFO: `/v3/users/22d6397c92094e0f981587b0d0d5ce6d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:37.245276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d6397c92094e0f981587b0d0d5ce6d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:37.247212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:37.292191 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d6397c92094e0f981587b0d0d5ce6d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.292840 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d6397c92094e0f981587b0d0d5ce6d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.293448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d6397c92094e0f981587b0d0d5ce6d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.305010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d6397c92094e0f981587b0d0d5ce6d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.312316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d6397c92094e0f981587b0d0d5ce6d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.325164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1321/2634] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:01:37 2022] DELETE /identity/v3/users/22d6397c92094e0f981587b0d0d5ce6d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:37.329723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:37.330291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:37.330406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:37.349035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:01:37.350259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:37.408451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1314/2635] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:01:37.418369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:37.419765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:37.478092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59550c06-7ccc-40f1-af31-d8260dfafd28 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:37.481848 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:37.482480 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:37.482806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:37.483121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:37.492503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:37.494691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2122f-fb6d-41e7-a0aa-a2859a577850 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:37.503974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1322/2636] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:01:37.672232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:01:37.673902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:01:37.687114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135c7a6-1b3b-4b6c-923a-4433740dd0d5 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:01:37.691668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:01:37.692306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:01:37.692591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:01:37.692870 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] PATH_INFO: `/v3/projects/5f3a8d91effb499081c9943815b29d3b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:01:37.694057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3a8d91effb499081c9943815b29d3b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:01:37.695961 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:01:37.740466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:37.745384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3a8d91effb499081c9943815b29d3b', 'request_id': 'req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.752631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3a8d91effb499081c9943815b29d3b', 'request_id': 'req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.758383 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3a8d91effb499081c9943815b29d3b', 'request_id': 'req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.769605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] The token cache is being invalidate because project 5f3a8d91effb499081c9943815b29d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:01:37.769926 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.770555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:01:37.772036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1315/2637] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:01:37 2022] DELETE /identity/v3/projects/5f3a8d91effb499081c9943815b29d3b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:01:47.499799 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:47.766605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:02:32.620899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:02:32.621435 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:02:32.621551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:02:32.641036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] MFA Rules not processed for user `de93d70b46e6422f8aeb1effc49b02ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:02:32.642265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:32.698361 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1323/2638] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:02:33.004608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:02:33.006026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:33.065443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987fd5-7cac-4f10-a61e-0c507ffc1b63 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:02:33.068948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:02:33.069559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:02:33.069868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:02:33.070148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:02:33.071919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:33.081238 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:02:33.082680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:02:33.090764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1316/2639] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:02:33.411948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:02:33.413415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:33.610189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6576da1-9885-4c69-848b-d1725cdd1416 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:02:33.615444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:02:33.616060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:02:33.616345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:02:33.616626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:02:33.618580 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:33.629927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:02:33.631502 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:02:33.641411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1324/2640] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:02:35.450481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:02:35.451948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:35.462466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62e71b-a193-4a67-b8e7-6f11c33806f3 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:02:35.466117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:02:35.466727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:02:35.467003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:02:35.467272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:02:35.469045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:35.479881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:02:35.481361 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:02:35.490377 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1317/2641] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:02:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:02:43.637259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=57 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:02:44.248473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:02:44.250166 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:44.325527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971dc0-e05b-4d83-88d7-412656d324ed service placement] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:02:44.330945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:02:44.331566 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:02:44.331853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:02:44.332134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:02:44.333908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:02:44.347240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:02:44.348827 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:02:44.359930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1325/2642] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:02:45.486369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=32 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:02:54.355168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=34 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:10.019137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:10.033753 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8366e8-74aa-4f44-af26-cb2524958394 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:10.039206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:10.039816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:10.040097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:10.040372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:10.042868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:10.121371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:10.122966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:10.140978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1318/2643] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:17.114992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:17.124972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499721f-a027-43ee-944b-632eae69e49e service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:17.128501 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:17.129108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:17.129389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:17.129662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:17.131390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:17.193888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:17.195325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:17.204923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1326/2644] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:20.138468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=41 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:20.356169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:20.367950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee4d5-65c9-4715-941a-aee7837a3400 service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:20.373061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:20.373693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.374181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.374463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.376242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:20.388590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:20.390206 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:20.401649 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1319/2645] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:20.410845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:20.412300 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:20.425834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37307856-4118-46ab-afff-ed480fa468bc service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:20.431095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:20.431471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.432551 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.433037 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] PATH_INFO: `/v3/users/05776e7045fc4e44887cc3cf25e35ffd` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.435609 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05776e7045fc4e44887cc3cf25e35ffd)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:20.437155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:20.485003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05776e7045fc4e44887cc3cf25e35ffd'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.485666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05776e7045fc4e44887cc3cf25e35ffd'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.486305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05776e7045fc4e44887cc3cf25e35ffd'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.498773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05776e7045fc4e44887cc3cf25e35ffd'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.505412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-33e6e78f-a4c2-4a06-b05d-43adc6539108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05776e7045fc4e44887cc3cf25e35ffd'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.518552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1327/2646] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:20 2022] DELETE /identity/v3/users/05776e7045fc4e44887cc3cf25e35ffd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:20.694932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:20.706919 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86dd6-885d-4cfa-94d4-484d303b6bd3 service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:20.767645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:20.768274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.768557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.768832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] PATH_INFO: `/v3/projects/f3406960d0cf4732af74dd60a55e90f8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.770006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3406960d0cf4732af74dd60a55e90f8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:20.771883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:20.816315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3406960d0cf4732af74dd60a55e90f8', 'request_id': 'req-a2d59d25-0a45-4b76-9811-99d5b35de7ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.823927 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3406960d0cf4732af74dd60a55e90f8', 'request_id': 'req-a2d59d25-0a45-4b76-9811-99d5b35de7ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.829643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3406960d0cf4732af74dd60a55e90f8', 'request_id': 'req-a2d59d25-0a45-4b76-9811-99d5b35de7ca'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.840528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] The token cache is being invalidate because project f3406960d0cf4732af74dd60a55e90f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:20.840818 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.841471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-a2d59d25-0a45-4b76-9811-99d5b35de7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:20.843330 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1320/2647] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:20 2022] DELETE /identity/v3/projects/f3406960d0cf4732af74dd60a55e90f8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:20.848249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.848536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.848811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.868516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:20.870463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:20.928067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1328/2648] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:20.937485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.937863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.938081 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.957705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:20.958942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:20.966910 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1321/2649] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:20.971063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:20.981060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399dde5-f508-4455-af46-61e29f1a5fd2 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:20.985554 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:20.986192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:20.986475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:20.986749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:20.987432 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:20.987736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:20.989561 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:20.991029 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:21.007899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1329/2650] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:21.009032 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.018321 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4cf10-81af-4ef3-b05e-fdd3900d58de None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.022948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.023584 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.023866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.024140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.024819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.026756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.065368 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1322/2651] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:03:21.069507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.079514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d759ff-7b9a-45c1-959c-29d31389730e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.135783 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.136390 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.136677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.136955 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.137613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.139555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.159895 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1330/2652] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:21.164020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.175419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813700-3989-48a9-917b-6e968ef43678 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.179966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.180559 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.180837 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.181108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.181868 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.184663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.194775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1323/2653] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:21.198546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.208393 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2852-4501-4647-89e7-81af457a1707 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.213001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.213629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.213964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.214254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.214975 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.216552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33d9c8-b662-44c4-a514-a991850d4428 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.226366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1331/2654] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:21.231443 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.241587 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa3a6-7239-4dc8-b6e7-adeb9847d3f8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.247320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.248013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.248292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.248565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] PATH_INFO: `/v3/projects/cc066bc51b9b4ceeb401f89cd3a6465f/users/38a63b4f8da2438a8d684afebaca14e2/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.263601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc066bc51b9b4ceeb401f89cd3a6465f, user_id=38a63b4f8da2438a8d684afebaca14e2, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.266276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.279520 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1324/2655] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:21 2022] PUT /identity/v3/projects/cc066bc51b9b4ceeb401f89cd3a6465f/users/38a63b4f8da2438a8d684afebaca14e2/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:21.289732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.290063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.290345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.318083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] MFA Rules not processed for user `38a63b4f8da2438a8d684afebaca14e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:21.319298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:21.382159 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1332/2656] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:21.386887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.392436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:21.451538 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21a84-a66f-4ada-98d7-40011ab5abfa admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.456026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.456627 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.456907 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.457181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.457855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.459721 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.486517 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1325/2657] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:21.490772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.501653 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb354-df01-4831-8999-e606a212f9ba None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.556898 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.557795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.558098 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.558373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.559036 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.560924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.569780 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:21.583846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1333/2658] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:21.587666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.599092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450ec5-b45b-41c4-8087-6fa50f43e562 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.603619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.604979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.605335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.605612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.606334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.607906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.618671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1326/2659] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:21.623189 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.633668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36418a6-42e2-464a-b73a-81a440cb10fb admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.639126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.639897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.640185 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.640487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] PATH_INFO: `/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156/users/d168bd6d45784822a0248a6b9c721ab6/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.656395 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084d5f334fe64fc6a2ab7d735c2b7156, user_id=d168bd6d45784822a0248a6b9c721ab6, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.659099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.672786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1334/2660] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:21 2022] PUT /identity/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156/users/d168bd6d45784822a0248a6b9c721ab6/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:21.676770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.687756 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a95bd8-d124-41aa-9784-01d1e931d037 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.744067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.745203 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.745484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.745761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.746483 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.748082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9af1-9cd7-454e-9aa5-88a59057bd4e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.757696 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1327/2661] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:21.762318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.772341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdff06-0124-4158-be20-0dea19f4d8c0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.777215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.777893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.778178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.778457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] PATH_INFO: `/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156/users/d168bd6d45784822a0248a6b9c721ab6/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.780431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084d5f334fe64fc6a2ab7d735c2b7156, user_id=d168bd6d45784822a0248a6b9c721ab6, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:21.783095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:21.796473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1335/2662] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:21 2022] PUT /identity/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156/users/d168bd6d45784822a0248a6b9c721ab6/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:21.809159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.809463 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.809739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:21.837618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] MFA Rules not processed for user `d168bd6d45784822a0248a6b9c721ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:21.838874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:21.907046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:21.911468 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1328/2663] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:21.923193 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:21.924930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:21.986448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab7057-e038-49b2-ba1d-42be99a15922 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:21.990348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:21.990971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:21.991255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:21.991538 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:22.053190 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:22.054720 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:22.063866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1336/2664] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:24.623763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:24.633289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9dbe8-882f-41df-a113-d8d9954f90ab None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:24.637038 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:24.637637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:24.637946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:24.638219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:24.646985 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:24.648399 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7fc0c-402a-42cd-badb-6d77e1809a08 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:24.657549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1329/2665] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:32.059724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:INSERT=4,keystone:SELECT=65 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:34.653510 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=6 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:37.106643 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:37.168051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd11d-6737-4948-bc8b-fa5e991693c5 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:37.173048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:37.173685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:37.174027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:37.174308 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] PATH_INFO: `/v3/users/38a63b4f8da2438a8d684afebaca14e2` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:37.175465 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a63b4f8da2438a8d684afebaca14e2)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:37.177377 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:37.225903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a63b4f8da2438a8d684afebaca14e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.226578 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a63b4f8da2438a8d684afebaca14e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.227178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a63b4f8da2438a8d684afebaca14e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.238896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a63b4f8da2438a8d684afebaca14e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.245821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a63b4f8da2438a8d684afebaca14e2'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.259319 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1337/2666] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:37 2022] DELETE /identity/v3/users/38a63b4f8da2438a8d684afebaca14e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:37.264449 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:37.264951 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:37.265068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:37.284003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:37.285179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:37.342199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1330/2667] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:37.351950 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:37.353486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:37.410288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155c05-44e7-49b2-b573-b4473de91b0b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:37.413984 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:37.414599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:37.414889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:37.415168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:37.424854 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:37.426315 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:37.436109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1338/2668] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:37.703563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:37.705008 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:37.717491 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753238db-7cb5-4b20-a388-495ef31b7ff3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:37.722237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:37.722878 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:37.723164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:37.723437 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] PATH_INFO: `/v3/projects/cc066bc51b9b4ceeb401f89cd3a6465f` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:37.724608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc066bc51b9b4ceeb401f89cd3a6465f)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:37.726563 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:37.786309 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc066bc51b9b4ceeb401f89cd3a6465f', 'request_id': 'req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.793311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc066bc51b9b4ceeb401f89cd3a6465f', 'request_id': 'req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.799579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc066bc51b9b4ceeb401f89cd3a6465f', 'request_id': 'req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.810690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] The token cache is being invalidate because project cc066bc51b9b4ceeb401f89cd3a6465f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:37.810975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.811614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.813123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1331/2669] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:37 2022] DELETE /identity/v3/projects/cc066bc51b9b4ceeb401f89cd3a6465f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:37.817120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:37.827013 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f2a7-9d85-4ed4-af07-c54d83b4e989 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:37.845576 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:37.884821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:37.885457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:37.885738 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:37.886046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] PATH_INFO: `/v3/users/d168bd6d45784822a0248a6b9c721ab6` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:37.887198 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d168bd6d45784822a0248a6b9c721ab6)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:37.889144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:37.934109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd168bd6d45784822a0248a6b9c721ab6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.934777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd168bd6d45784822a0248a6b9c721ab6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.935486 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd168bd6d45784822a0248a6b9c721ab6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.947680 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd168bd6d45784822a0248a6b9c721ab6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.954924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-766a7d92-fb2d-4c69-9b54-853ecd277325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd168bd6d45784822a0248a6b9c721ab6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:37.968444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1339/2670] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:37 2022] DELETE /identity/v3/users/d168bd6d45784822a0248a6b9c721ab6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:38.240043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.241498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:38.255751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bed6d-b4e0-452e-b492-ba00ccf3495a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.314768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.315445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.315667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.315939 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] PATH_INFO: `/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.317068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084d5f334fe64fc6a2ab7d735c2b7156)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.319014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.355199 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:38.374292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084d5f334fe64fc6a2ab7d735c2b7156', 'request_id': 'req-321b62ed-0949-4a73-b111-ed64133ba077'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:38.381276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084d5f334fe64fc6a2ab7d735c2b7156', 'request_id': 'req-321b62ed-0949-4a73-b111-ed64133ba077'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:38.387099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084d5f334fe64fc6a2ab7d735c2b7156', 'request_id': 'req-321b62ed-0949-4a73-b111-ed64133ba077'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:38.398830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] The token cache is being invalidate because project 084d5f334fe64fc6a2ab7d735c2b7156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:38.399119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:38.399761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-321b62ed-0949-4a73-b111-ed64133ba077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:38.401253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1332/2671] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:38 2022] DELETE /identity/v3/projects/084d5f334fe64fc6a2ab7d735c2b7156 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:38.407155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.407723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.407723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.426863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:38.428096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:38.491092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1340/2672] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:38.499363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.499634 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.499937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.519977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:38.521173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:38.529494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1333/2673] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:03:38.533658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.543333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8318b-7411-40f2-852f-2e4d14cb7751 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.548054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.548657 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.548946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.549234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.549968 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:38.550283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.551876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.563919 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1341/2674] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:38.568208 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.578119 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5a7db-c20a-4b6d-b619-dcd405f47f85 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.582680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.583273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.583553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.583827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.584496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.586444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.614388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1334/2675] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:03:38.618691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.629208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f2c7-8c89-4333-bbf3-6dcdff210dc7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.655856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:38.687768 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.688383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.688666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.688972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.689647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.691611 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.712924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1342/2676] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:38.717259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.727375 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6428d-3484-4a57-b5ee-453d938e002a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.732139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.732734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.733014 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.733296 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.734210 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.735791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.745830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1335/2677] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:38.750544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.760276 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8313c4-2297-4a22-a532-92b6aa45796c admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.765456 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.766090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.766375 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.766650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.767382 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.768966 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c21cc5-c265-49de-a2f2-867b411c20ce admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.779479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1343/2678] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:38.783645 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.793923 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40c8f3-4f83-451d-9770-bb30211a054b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:38.799315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:38.799956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.800232 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.800509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] PATH_INFO: `/v3/projects/50ad3f39e55744d69cd2d6fe93a6a586/users/9e157020b5d8451f8c43c97883f59c94/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.815663 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ad3f39e55744d69cd2d6fe93a6a586, user_id=9e157020b5d8451f8c43c97883f59c94, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:38.818308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:38.831794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1336/2679] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:38 2022] PUT /identity/v3/projects/50ad3f39e55744d69cd2d6fe93a6a586/users/9e157020b5d8451f8c43c97883f59c94/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:38.842171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:38.842459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:38.842739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:38.870112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] MFA Rules not processed for user `9e157020b5d8451f8c43c97883f59c94`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:38.871318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:38.932845 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1344/2680] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:38.938105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:38.999875 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7c61-293f-444c-9245-1704f43d837e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.004479 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.005082 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.005364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.005641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.006342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.008219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.035588 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1337/2681] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:38 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:03:39.039648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.051102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b306d1-6e33-4eb4-b8bf-ccf88a1e9b0e None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.105749 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.106389 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.107328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.107792 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.108468 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.110384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.132383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1345/2682] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:39 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:39.136326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.146809 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d4989-fc77-4aa5-89d9-fe481ffdb65b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.151338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.151935 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.152213 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.152484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.153169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.155860 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.166566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1338/2683] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:39.171405 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.181062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6fdcf-aa5b-4bfa-b667-f80cb8c3fdbb admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.185620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.186251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.186556 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.186811 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] PATH_INFO: `/v3/projects/afacd5a437514f569e34c1658748263e/users/f14369178254429a8ae87b05011bc200/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.200958 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afacd5a437514f569e34c1658748263e, user_id=f14369178254429a8ae87b05011bc200, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.203613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.216671 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1346/2684] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:39 2022] PUT /identity/v3/projects/afacd5a437514f569e34c1658748263e/users/f14369178254429a8ae87b05011bc200/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:39.220609 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.230502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e19f9a-1c9f-487d-bf3b-d093829c898a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.250929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:39.289328 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.289975 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.290256 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.290530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.291221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.292789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7a5fc-321f-4793-87bb-1413fac4684b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.303005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1339/2685] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:39.307069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.312777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:39.319207 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71548115-2b95-400c-a91d-2eb0c1997963 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.324060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.324714 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.324997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.325301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] PATH_INFO: `/v3/projects/afacd5a437514f569e34c1658748263e/users/f14369178254429a8ae87b05011bc200/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.327368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afacd5a437514f569e34c1658748263e, user_id=f14369178254429a8ae87b05011bc200, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.330068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.339935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1347/2686] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:39 2022] PUT /identity/v3/projects/afacd5a437514f569e34c1658748263e/users/f14369178254429a8ae87b05011bc200/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:39.351467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.351962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.352070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.380603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] MFA Rules not processed for user `f14369178254429a8ae87b05011bc200`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:39.381830 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:39.450251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1340/2687] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:39.460709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.462478 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:39.519250 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4626-4f10-482f-a44a-8ed3604f5b7e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.522961 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.523567 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.523849 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.524122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.533607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.535067 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.544446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1348/2688] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:39.645412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:39.655715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606deef3-cd50-4d00-a222-8ccf3193f5ba None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:39.659338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:39.659943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:39.660250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:39.660526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:39.716724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:39.718191 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168b226-4e8e-47c9-b582-3e8f6cc5f0d5 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:39.726903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1341/2689] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:42.313754 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:42.378857 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e240a-6dff-4f05-a851-f64c52429c49 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:42.383381 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:42.384014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:42.384298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:42.384573 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] PATH_INFO: `/v3/users/9e157020b5d8451f8c43c97883f59c94` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:42.385727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e157020b5d8451f8c43c97883f59c94)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:42.387734 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:42.433707 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e157020b5d8451f8c43c97883f59c94'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:42.434373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e157020b5d8451f8c43c97883f59c94'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:42.435104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e157020b5d8451f8c43c97883f59c94'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:42.446918 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e157020b5d8451f8c43c97883f59c94'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:42.453636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e157020b5d8451f8c43c97883f59c94'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:42.467475 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1349/2690] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:42 2022] DELETE /identity/v3/users/9e157020b5d8451f8c43c97883f59c94 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:42.472052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:42.472561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:42.472697 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:42.492794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:42.494004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:42.533172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:42.552311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1342/2691] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:03:42.562562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:42.564027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:42.577484 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:42.624055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7bce-6cba-421a-91bd-35b1cdbf6ce7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:42.627737 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:42.628354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:42.628646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:42.628925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:42.638104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:42.639638 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:42.649128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1350/2692] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:42.920477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:42.921991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:42.936689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c242b1a-4630-42ff-abc3-e6a222fca732 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:42.942442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:42.943253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:42.944171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:42.944497 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] PATH_INFO: `/v3/projects/50ad3f39e55744d69cd2d6fe93a6a586` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:42.946130 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ad3f39e55744d69cd2d6fe93a6a586)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:42.948291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:42.996929 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ad3f39e55744d69cd2d6fe93a6a586', 'request_id': 'req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.004376 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ad3f39e55744d69cd2d6fe93a6a586', 'request_id': 'req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.009854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ad3f39e55744d69cd2d6fe93a6a586', 'request_id': 'req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.021580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] The token cache is being invalidate because project 50ad3f39e55744d69cd2d6fe93a6a586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:43.021891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.022575 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.024224 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1343/2693] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:42 2022] DELETE /identity/v3/projects/50ad3f39e55744d69cd2d6fe93a6a586 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:43.028979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.038762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7aab6-33ce-4b30-b156-33b2d3c1a8ac service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.095338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.095893 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.096175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.096450 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] PATH_INFO: `/v3/users/f14369178254429a8ae87b05011bc200` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.097589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14369178254429a8ae87b05011bc200)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.099518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.144085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14369178254429a8ae87b05011bc200'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.144725 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14369178254429a8ae87b05011bc200'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.145325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14369178254429a8ae87b05011bc200'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.157449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14369178254429a8ae87b05011bc200'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.164074 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-a022522d-db67-4540-bf5f-1b4297e18c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14369178254429a8ae87b05011bc200'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.175948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1351/2694] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:43 2022] DELETE /identity/v3/users/f14369178254429a8ae87b05011bc200 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:43.441606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.443067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:43.459980 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf995ab-59e8-483d-8fc5-b92561e1b4c3 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.520042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.520680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.520944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.521216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] PATH_INFO: `/v3/projects/afacd5a437514f569e34c1658748263e` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.522385 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afacd5a437514f569e34c1658748263e)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.524274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.569658 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afacd5a437514f569e34c1658748263e', 'request_id': 'req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.577859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afacd5a437514f569e34c1658748263e', 'request_id': 'req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.583780 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afacd5a437514f569e34c1658748263e', 'request_id': 'req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.590614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:43.595805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] The token cache is being invalidate because project afacd5a437514f569e34c1658748263e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:43.596290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.597457 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-cc13ae34-7cf2-4500-a0a2-659a6d3bb236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:43.599159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1344/2695] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:43 2022] DELETE /identity/v3/projects/afacd5a437514f569e34c1658748263e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:43.604045 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.604519 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.604635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.625284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:43.629855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:43.655041 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:43.687548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1352/2696] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:03:43.695405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.695695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.695978 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.715593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:43.716912 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:43.724803 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1345/2697] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:43.728930 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.739463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f62e-a128-497d-9231-a3f701b0665d None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.744324 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.744928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.745209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.745485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.746206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:43.746512 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.748897 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.760148 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1353/2698] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:43.764572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.773703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af19b4-e89f-4e97-9beb-6040f41187b1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.778299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.778998 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.779275 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.779544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.780205 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.782101 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.810638 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1346/2699] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:43 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:03:43.814750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.824743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b9b1e-8d7f-4d5e-ae7f-0814eedd7380 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.880557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.881109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.881383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.881660 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.882373 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.884268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.904350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1354/2700] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:43 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:43.908805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.919812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbf9b-1501-43d1-86cf-15b9cbe64c7d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.924367 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.924958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.925236 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.925505 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.926227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.927794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.938181 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1347/2701] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:03:43.942171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.953629 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fc80-7a20-4180-b59d-66f46e0f7cfe admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.958211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.958814 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.959102 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.959371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:43.960062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:43.961635 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ad68-bc66-4950-a0e6-384aca7d655a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:43.972916 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1355/2702] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:43.977141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:43.987662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc62c6-8a74-4f1c-81ec-2d5d814f864b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:43.992469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:43.993115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:43.993393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:43.993665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] PATH_INFO: `/v3/projects/bf71f7f250b24047a35a9da7771995c7/users/c40fafaf622b4d9fbb24740bd91aeb1d/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.008955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf71f7f250b24047a35a9da7771995c7, user_id=c40fafaf622b4d9fbb24740bd91aeb1d, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:44.011637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:44.024582 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1348/2703] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:43 2022] PUT /identity/v3/projects/bf71f7f250b24047a35a9da7771995c7/users/c40fafaf622b4d9fbb24740bd91aeb1d/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:44.035649 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.035943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.036222 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.064491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] MFA Rules not processed for user `c40fafaf622b4d9fbb24740bd91aeb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:44.065740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:44.128002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1356/2704] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:44.139099 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:44.140804 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:44.197349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d167-afc1-41ae-9c80-bc92c6194a09 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:44.201198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:44.201801 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.202117 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.202392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.210657 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:44.212063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54ba8-c35b-468b-a57c-4da563b80965 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:44.221019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1349/2705] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:44.242832 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:44.273772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:44.305752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f7e35-2aaf-422d-9fbd-568646f8eedd None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:44.311864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:44.312506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.312794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.313079 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] PATH_INFO: `/v3/users/c40fafaf622b4d9fbb24740bd91aeb1d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.314296 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40fafaf622b4d9fbb24740bd91aeb1d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:44.316255 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:44.360850 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40fafaf622b4d9fbb24740bd91aeb1d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.361500 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40fafaf622b4d9fbb24740bd91aeb1d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.362179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40fafaf622b4d9fbb24740bd91aeb1d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.375675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40fafaf622b4d9fbb24740bd91aeb1d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.389065 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40fafaf622b4d9fbb24740bd91aeb1d'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.401068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1357/2706] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:44 2022] DELETE /identity/v3/users/c40fafaf622b4d9fbb24740bd91aeb1d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:44.405973 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.406261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.406537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.425887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:44.427083 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:44.486147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1350/2707] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:44.496155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:44.497742 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:44.554170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041012a-ed7d-43d7-a16c-4de2d3d91e9f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:44.557969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:44.558596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.558881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.559161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.568637 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:44.570092 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8edd-6a14-413f-aca9-89131b7fe74a service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:44.579459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1358/2708] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:44.855526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:44.857085 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:44.870237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb673d-7298-4412-80e2-d3069c01dc8f None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:44.874981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:44.875633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.876253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.876253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] PATH_INFO: `/v3/projects/bf71f7f250b24047a35a9da7771995c7` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.877342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf71f7f250b24047a35a9da7771995c7)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:44.879303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:44.914644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:44.928021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf71f7f250b24047a35a9da7771995c7', 'request_id': 'req-1090f3e8-66bf-44c1-850c-0871371b9eaf'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.935422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf71f7f250b24047a35a9da7771995c7', 'request_id': 'req-1090f3e8-66bf-44c1-850c-0871371b9eaf'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.941228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf71f7f250b24047a35a9da7771995c7', 'request_id': 'req-1090f3e8-66bf-44c1-850c-0871371b9eaf'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.954108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] The token cache is being invalidate because project bf71f7f250b24047a35a9da7771995c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:44.954394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.955034 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1090f3e8-66bf-44c1-850c-0871371b9eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:44.956524 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1351/2709] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:44 2022] DELETE /identity/v3/projects/bf71f7f250b24047a35a9da7771995c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:44.961363 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:44.961882 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:44.962000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:44.981745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:44.983097 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:45.027572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:45.044615 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1359/2710] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:45.052345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.052630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.052902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.073336 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:45.074550 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:45.083047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1352/2711] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:45.087257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.097833 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db088-e9ff-4d73-b4a8-607865d7bd9b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.102506 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.103118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.103409 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.103693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.104391 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:45.104727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.106408 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.118022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1360/2712] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:45.122137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.131314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c60a-3df3-49c1-9123-c8c2f9234274 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.135966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.136557 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.136833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.137105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.138454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.140473 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.168050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1353/2713] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:45 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:45.172199 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.182211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ccff-e5f6-4b66-968d-d7f4d599b1ca admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.238535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.239146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.239425 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.239954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.240598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.242546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.264881 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1361/2714] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:45 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:03:45.269041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.280220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196a32f-6ce9-4a6e-ad70-79c93fecc368 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.284826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.285420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.285694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.285995 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.286677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.288280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.299009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1354/2715] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:03:45.303061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.313586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545155f-039a-4b01-8b4a-704f7a9ca161 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.318195 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.318801 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.319085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.319362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.320057 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.321644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357126-f746-4f63-b9f8-f2d73fc2b8cf admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.332900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1362/2716] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:45.336987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.347749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076031-876b-4aaa-b554-04a7ef378ecf admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.352467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.353125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.353419 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.353686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] PATH_INFO: `/v3/projects/071fe99d10544df685e7cafd20e5f51b/users/9522dda068fc479997c72a1b8af4dbe5/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.368826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071fe99d10544df685e7cafd20e5f51b, user_id=9522dda068fc479997c72a1b8af4dbe5, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.371518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.384149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1355/2717] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:45 2022] PUT /identity/v3/projects/071fe99d10544df685e7cafd20e5f51b/users/9522dda068fc479997c72a1b8af4dbe5/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:45.395060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.395350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.395631 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.422278 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] MFA Rules not processed for user `9522dda068fc479997c72a1b8af4dbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:45.423413 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:45.485571 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1363/2718] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:45.496474 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:45.498750 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:45.554600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950381-8cca-42e5-b0d0-e5675f49ab60 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:45.558362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:45.558968 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:45.559252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:45.560023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:45.568369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:45.569797 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ef78-e282-4f0c-b027-4ec815a32987 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:45.579348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1356/2719] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:50.890341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:50.937088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:50.954401 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4090f5-14cc-42c3-8f21-459219f5c670 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:50.958837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:50.959471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:50.959750 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:50.960022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] PATH_INFO: `/v3/users/9522dda068fc479997c72a1b8af4dbe5` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:50.961160 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9522dda068fc479997c72a1b8af4dbe5)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:50.963112 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.009242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9522dda068fc479997c72a1b8af4dbe5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.009921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9522dda068fc479997c72a1b8af4dbe5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.010547 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9522dda068fc479997c72a1b8af4dbe5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.024496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9522dda068fc479997c72a1b8af4dbe5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.032218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9522dda068fc479997c72a1b8af4dbe5'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.045294 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1364/2720] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:50 2022] DELETE /identity/v3/users/9522dda068fc479997c72a1b8af4dbe5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:51.049762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.050251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.050364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.068604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:51.069791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:51.120794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:51.133631 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1357/2721] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:51.141976 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.143431 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:51.199619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccca4-593f-42bd-9841-692639607067 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.203977 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.204587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.204869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.205147 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.214114 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.215546 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a9d5b-4f8f-4c01-8ca1-bf1c997e80f3 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.225158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1365/2722] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:51.489901 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.491384 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:51.504850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb153a-924f-4ab5-8720-5c6dff6d6a4c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.509456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.510273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.510555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.510827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] PATH_INFO: `/v3/projects/071fe99d10544df685e7cafd20e5f51b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.511982 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071fe99d10544df685e7cafd20e5f51b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.513945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.563431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071fe99d10544df685e7cafd20e5f51b', 'request_id': 'req-bd550159-811f-4443-9fd1-ab6a1ec40cf5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.570844 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071fe99d10544df685e7cafd20e5f51b', 'request_id': 'req-bd550159-811f-4443-9fd1-ab6a1ec40cf5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.577426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071fe99d10544df685e7cafd20e5f51b', 'request_id': 'req-bd550159-811f-4443-9fd1-ab6a1ec40cf5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.588886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] The token cache is being invalidate because project 071fe99d10544df685e7cafd20e5f51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:51.589170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.589831 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-bd550159-811f-4443-9fd1-ab6a1ec40cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:51.591315 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1358/2723] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:51 2022] DELETE /identity/v3/projects/071fe99d10544df685e7cafd20e5f51b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:51.596970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.597266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.597545 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.616805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:51.618062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:51.678599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1366/2724] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:51.688033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.688364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.688641 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.708347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:51.709521 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:51.717796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1359/2725] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:51.721993 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.731711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582074f-e4ae-41b1-bd71-dcbfc005fb27 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.736359 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.736964 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.737249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.737530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.738260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:51.738569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.740420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.742774 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:51.755000 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1367/2726] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:51.757570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.767446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca593-58ce-4b17-9f55-2a722144a924 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.772073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.772673 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.772953 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.773225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.773943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.775866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.804225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1360/2727] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:51 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:51.808429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.819124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5101c45-2184-446e-a96a-77ee3e2963b3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.873109 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.874442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.874726 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.875001 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.875667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.877572 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.897620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1368/2728] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:51 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:51.901741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.913073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139036f4-aa5d-4eb2-94b7-88f684de9b29 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.917722 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.918362 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.918653 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.918930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.919623 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.921859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.932059 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1361/2729] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:51.935912 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.946021 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fa31d-6a8c-4fd3-8a4b-30aead0e4940 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.950899 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.951531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.951817 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.952096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:51.952794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:51.954419 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f767-d39e-4bea-8c1a-a9bcd6d7ff37 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:51.964834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1369/2730] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:51.969434 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:51.979528 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07716-baa4-4fd0-b219-88b1a6e8b9cc admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:51.985086 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:51.985743 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:51.986061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:51.986340 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] PATH_INFO: `/v3/projects/5f3f3a33a37948b7b9d609db83e3f48b/users/2f25adadce3e461884f35f4f6420fdd0/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.001173 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3f3a33a37948b7b9d609db83e3f48b, user_id=2f25adadce3e461884f35f4f6420fdd0, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:52.003850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:52.016311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1362/2731] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:51 2022] PUT /identity/v3/projects/5f3f3a33a37948b7b9d609db83e3f48b/users/2f25adadce3e461884f35f4f6420fdd0/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:52.027659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.027945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.028228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.057068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] MFA Rules not processed for user `2f25adadce3e461884f35f4f6420fdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:52.058313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:52.122343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1370/2732] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:52.155370 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:52.157217 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:52.212940 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d336a-a66e-4109-88f9-65cac25ae308 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:52.216681 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:52.218067 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.218353 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.218630 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.227072 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:52.228549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52fd36-d982-4a33-8161-f6ef3b6a3562 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:52.237977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1363/2733] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:52.253302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:52.313736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b2e3-5fd8-470a-81b4-6a6cd4861251 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:52.318290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:52.318913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.319197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.319467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] PATH_INFO: `/v3/users/2f25adadce3e461884f35f4f6420fdd0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.320607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f25adadce3e461884f35f4f6420fdd0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:52.322530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:52.327670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:52.369562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f25adadce3e461884f35f4f6420fdd0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.370254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f25adadce3e461884f35f4f6420fdd0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.370884 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f25adadce3e461884f35f4f6420fdd0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.383168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f25adadce3e461884f35f4f6420fdd0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.390552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f25adadce3e461884f35f4f6420fdd0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.402740 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1371/2734] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:52 2022] DELETE /identity/v3/users/2f25adadce3e461884f35f4f6420fdd0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:52.408185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.408472 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.408768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.428572 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:52.429773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:52.446710 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:52.493002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1364/2735] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:52.502646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:52.504048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:52.560921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f042f-0824-434e-b946-5a6fe201afa7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:52.564644 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:52.565252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.565531 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.565800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.574683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:52.576125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb73062-c412-495d-bc38-9f739ab7725a service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:52.585948 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1372/2736] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:52.847723 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:52.849189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:52.862823 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a200-b44d-40f9-8529-86f33b94892c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:52.868257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:52.869127 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.869442 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.869690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] PATH_INFO: `/v3/projects/5f3f3a33a37948b7b9d609db83e3f48b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.871100 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3f3a33a37948b7b9d609db83e3f48b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:52.874096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:52.921798 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3f3a33a37948b7b9d609db83e3f48b', 'request_id': 'req-2f2768f0-7477-455f-a368-8d551245962e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.928824 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3f3a33a37948b7b9d609db83e3f48b', 'request_id': 'req-2f2768f0-7477-455f-a368-8d551245962e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.934250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3f3a33a37948b7b9d609db83e3f48b', 'request_id': 'req-2f2768f0-7477-455f-a368-8d551245962e'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.946381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] The token cache is being invalidate because project 5f3f3a33a37948b7b9d609db83e3f48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:52.946620 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.947380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-2f2768f0-7477-455f-a368-8d551245962e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:52.949013 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1365/2737] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:52 2022] DELETE /identity/v3/projects/5f3f3a33a37948b7b9d609db83e3f48b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:52.954869 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:52.955341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:52.955455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:52.974771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:52.975960 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.034062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1373/2738] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:53.041716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.042030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.042306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.062636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:53.063813 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.071549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1366/2739] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:53.076038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.085668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60888dc4-f7c2-4322-b98b-00e37f4a5d9f None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.090321 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.090932 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.091215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.091496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.092444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:53.092936 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.094575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.105973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1374/2740] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:53.110833 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.120110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af0ee-38aa-40bf-abed-9b167de738c3 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.125274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.125883 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.126163 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.126429 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.127089 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.128946 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.155405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1367/2741] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:53 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:53.159537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.169528 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b54fb8-78a5-4dc1-b8a7-015347d3bfa0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.179523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:53.227082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.227690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.227971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.228248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.228909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.230837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.253313 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1375/2742] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:53 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:53.257395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.267724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04650906-a73f-477a-874f-2b6d153715e5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.272343 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.272947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.273233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.273514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.274243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.275819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.286471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1368/2743] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:53.290229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.300752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ccd2-fcec-4a8e-9ed2-f7c9c94cb9b2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.305379 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.306042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.306318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.306602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.307295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.308875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646bec8-6e3a-4570-a0fe-4103a394818f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.320134 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1376/2744] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:53.324052 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.334527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142b46-a5a6-4f64-b987-2c49994c34f0 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.339124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.339773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.340058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.340337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] PATH_INFO: `/v3/projects/7947213792884d52bc228080398fc0a9/users/253d290796044f9ebe84213839d12137/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.355218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7947213792884d52bc228080398fc0a9, user_id=253d290796044f9ebe84213839d12137, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.357922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.371002 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1369/2745] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:53 2022] PUT /identity/v3/projects/7947213792884d52bc228080398fc0a9/users/253d290796044f9ebe84213839d12137/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:03:53.438287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.438577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.438858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.466339 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] MFA Rules not processed for user `253d290796044f9ebe84213839d12137`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:53.467648 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.529773 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1377/2746] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:53.541096 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.542736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.588772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:53.601944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049f56-d271-4e95-879c-e09212a5bdb9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.605545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.606185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.606469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.606746 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.615382 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.616786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f695489-9431-4b7c-91ac-c47074d2bd49 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.626289 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1370/2747] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:53.650979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.713626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8a18a-ad6c-45a8-9f6d-6ac3b69b6b17 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.718931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.719568 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.719855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.720132 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] PATH_INFO: `/v3/users/253d290796044f9ebe84213839d12137` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.721299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253d290796044f9ebe84213839d12137)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.723253 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.745759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:53.771525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253d290796044f9ebe84213839d12137'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:53.772201 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253d290796044f9ebe84213839d12137'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:53.772823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253d290796044f9ebe84213839d12137'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:53.785769 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253d290796044f9ebe84213839d12137'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:53.792620 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253d290796044f9ebe84213839d12137'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:53.805115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1378/2748] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:03:53 2022] DELETE /identity/v3/users/253d290796044f9ebe84213839d12137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:53.809567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.809876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.810151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.830724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:53.832293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.890617 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1371/2749] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:53.900634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:53.902120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:53.960142 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09a79-6480-4aa9-8ffe-c14f28b293b5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:53.963812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:53.964427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:53.964708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:53.964982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:53.974553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:53.975979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:53.985794 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1379/2750] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:54.235644 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.237230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.257325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.258837 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.282126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde452a2-a3b8-42a3-a072-24a2f0b6f2dc service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.287015 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.288226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.288514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.288796 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] PATH_INFO: `/v3/projects/7947213792884d52bc228080398fc0a9` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.290228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7947213792884d52bc228080398fc0a9)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.292129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.318793 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5c6c7-03b8-4d6a-88b0-2a73806fb794 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.324832 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.325379 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.325665 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.326006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.328598 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.343908 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7947213792884d52bc228080398fc0a9', 'request_id': 'req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:54.350061 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7947213792884d52bc228080398fc0a9', 'request_id': 'req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:54.357800 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7947213792884d52bc228080398fc0a9', 'request_id': 'req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:54.368476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] The token cache is being invalidate because project 7947213792884d52bc228080398fc0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:03:54.368767 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:54.369404 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-fb33de1d-fd8a-4500-88e5-70ccc4ec6fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:03:54.370931 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1380/2751] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:03:54 2022] DELETE /identity/v3/projects/7947213792884d52bc228080398fc0a9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:54.376228 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.376514 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.376791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.388201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.390840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a9a4-2d87-404b-b721-f99387c34071 service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.397791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:54.399031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.400243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1372/2752] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:03:54.419242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:54.464632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1381/2753] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:54.472193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.472486 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.472769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.492740 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:54.494064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.502619 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1373/2754] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:54.506798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.517270 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d64f2-ae1e-4b12-9918-9d620646586b None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.522246 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.522942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.523233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.523511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.524212 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:03:54.524521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.526144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.538004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1382/2755] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:03:54.542595 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.553178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced765-64f9-4aec-b06c-9cd26e7bf7e8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.558179 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.558885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.559166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.559565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.560230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.563041 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.581172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:03:54.594802 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1374/2756] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:03:54 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:54.599659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.611070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a401-9a19-4876-b5bc-f71ec5c9d578 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.675400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.676028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.676690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.676690 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.677239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.679557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.703394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1383/2757] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:03:54 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:03:54.707671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.719532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f952660-c89b-469a-a650-d40080e84c51 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.725178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.725770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.726104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.726409 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.727168 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.728693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.743668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1375/2758] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:54.748239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.758766 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296cb1-c52c-46cb-b64d-ebe7c843012e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.763632 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.764909 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.765213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.765517 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.766257 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.767843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f627e2-ef09-4db1-a1cb-f8ada1d20d3d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.779023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1384/2759] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:03:54.783769 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.793583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f3d5f-431f-4b96-89c5-a25d5544c61d admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:54.798498 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:54.799149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.799433 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.799711 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] PATH_INFO: `/v3/projects/8412a5efe2ea4c51b855fe0ac2a93d36/users/024951253bb04ba4992cdb843f0d647c/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.815069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8412a5efe2ea4c51b855fe0ac2a93d36, user_id=024951253bb04ba4992cdb843f0d647c, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:54.817691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:54.832087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1376/2760] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:03:54 2022] PUT /identity/v3/projects/8412a5efe2ea4c51b855fe0ac2a93d36/users/024951253bb04ba4992cdb843f0d647c/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:03:54.843242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:54.843647 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:54.843937 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:54.871214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] MFA Rules not processed for user `024951253bb04ba4992cdb843f0d647c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:03:54.872455 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:54.937004 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1385/2761] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:03:54.949042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:03:54.950816 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:03:55.007950 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739d64-e106-40a7-a54a-795f976c6885 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:03:55.011571 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:03:55.012172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:03:55.012454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:03:55.012727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:03:55.021545 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:03:55.022999 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da651097-bbed-4295-a3af-636ccd521656 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:03:55.032043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1377/2762] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:00.005060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.037453 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:00.086727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0c12-bd90-43fb-ac89-de1d1dc080ba None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:00.091485 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:00.092129 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.092414 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.092694 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] PATH_INFO: `/v3/users/024951253bb04ba4992cdb843f0d647c` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.094154 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024951253bb04ba4992cdb843f0d647c)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:00.096135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:00.148691 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024951253bb04ba4992cdb843f0d647c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.149349 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024951253bb04ba4992cdb843f0d647c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.149991 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024951253bb04ba4992cdb843f0d647c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.162583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024951253bb04ba4992cdb843f0d647c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.169853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024951253bb04ba4992cdb843f0d647c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.185283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1386/2763] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:00 2022] DELETE /identity/v3/users/024951253bb04ba4992cdb843f0d647c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:00.190084 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.190554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.190655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.209499 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:00.210724 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:00.270771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1378/2764] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:00.281175 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.282724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:00.340575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f38bc-45fb-4a6e-9e12-2c06831f3ca4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:00.345495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:00.346411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.346582 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.347307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.356954 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:00.358476 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269b9f7-ce4f-4f0b-8153-4560f2b2b69e service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:00.369071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1387/2765] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:00.644512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.645988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:00.660110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236558d-e4de-488b-b16c-56ed8dc28bd8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:00.664611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:00.665252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.665532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.665996 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] PATH_INFO: `/v3/projects/8412a5efe2ea4c51b855fe0ac2a93d36` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.667169 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8412a5efe2ea4c51b855fe0ac2a93d36)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:00.669060 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:00.716092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8412a5efe2ea4c51b855fe0ac2a93d36', 'request_id': 'req-ace1383f-c399-4ca4-b253-c01ab2f35099'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.723966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8412a5efe2ea4c51b855fe0ac2a93d36', 'request_id': 'req-ace1383f-c399-4ca4-b253-c01ab2f35099'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.725166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:00.730928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8412a5efe2ea4c51b855fe0ac2a93d36', 'request_id': 'req-ace1383f-c399-4ca4-b253-c01ab2f35099'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.742748 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] The token cache is being invalidate because project 8412a5efe2ea4c51b855fe0ac2a93d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:00.743035 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.743686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-ace1383f-c399-4ca4-b253-c01ab2f35099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:00.745182 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1379/2766] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:00 2022] DELETE /identity/v3/projects/8412a5efe2ea4c51b855fe0ac2a93d36 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:00.750204 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.750495 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.750797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.770759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:00.772115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:00.818186 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:00.839743 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1388/2767] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:00.847892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.848184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.848464 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.868253 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:00.869458 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:00.877920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1380/2768] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:00.882133 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.892821 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c8c2e-df83-44e2-ab64-36179571bd58 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:00.897386 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:00.898023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.898307 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.898581 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.899274 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:04:00.899594 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:00.901163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:00.913155 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1389/2769] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:04:00.917448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.926885 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21419976-edcb-4a53-9724-3c9797716b80 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:00.931476 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:00.932111 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:00.932342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:00.932618 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:00.933282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:00.935209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:00.962714 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1381/2770] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:00 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:00.967069 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:00.976889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba904c6-a808-4ae5-a62a-51af1a9594c2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:01.036071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:01.036732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.036997 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.037273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.038018 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:01.039923 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:01.060904 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1390/2771] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:01.065786 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:01.076380 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfcb91-ab6c-4845-b636-542282a36a54 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:01.081855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:01.082469 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.082755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.083021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.083707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:01.085282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:01.095925 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1382/2772] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:01.100121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:01.110951 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d573d-fd14-4304-98f7-067dd8f82555 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:01.115990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:01.116593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.116875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.117152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.117876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:01.119503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8d1f-16b3-463a-9329-82b8438f3073 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:01.130674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1391/2773] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:01.134845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:01.145686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7f2a-662a-4323-bae3-2e25cb4c668b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:01.150220 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:01.150869 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.151148 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.151422 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] PATH_INFO: `/v3/projects/fa00345ed1874deda6c56753cc29f8d9/users/f1409edcf43240ee83460037d78ece2b/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.165768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa00345ed1874deda6c56753cc29f8d9, user_id=f1409edcf43240ee83460037d78ece2b, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:01.168427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:01.181153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1383/2774] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:01 2022] PUT /identity/v3/projects/fa00345ed1874deda6c56753cc29f8d9/users/f1409edcf43240ee83460037d78ece2b/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:01.186104 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd5d5-de48-44dd-b790-8b600f5abdd1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.186396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd5d5-de48-44dd-b790-8b600f5abdd1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.186676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd5d5-de48-44dd-b790-8b600f5abdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.206085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-131cd5d5-de48-44dd-b790-8b600f5abdd1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:01.207289 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-131cd5d5-de48-44dd-b790-8b600f5abdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:01.265887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1392/2775] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:01.275355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:01.277070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:01.334073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1e3f8-23cf-49a6-849a-807b621ce835 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:01.337611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:01.338240 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:01.338518 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:01.338789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:01.347882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:01.349288 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:01.358444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1384/2776] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:05.269182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.270206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.270650 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.313181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] MFA Rules not processed for user `f1409edcf43240ee83460037d78ece2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:05.314805 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:05.369239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:05.412636 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1393/2777] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:05.417772 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.431676 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d0d8-c272-4d07-9466-1e6fca38da4e service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.437607 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.444078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.444078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.444078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.444078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.454291 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.486787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1385/2778] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:05 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:05.491080 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.503209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e336329-2ce1-43c0-8ae7-7da493838cac None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.571221 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.571959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.572245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.572521 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.573216 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.575169 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.602982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1394/2779] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:05 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:05.607075 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.640397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c722-394a-4fee-8159-8bd29b36be03 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.650583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.651299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.651688 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.652058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.652855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.654728 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.675439 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1386/2780] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:05.684085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.697283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cdd50-2495-4b7a-b6f2-d95f8d0e8a95 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.704053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.705108 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.705397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.705683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] PATH_INFO: `/v3/projects/d921c8d80fa946ea9080413332b5afaa/users/2471729723fe4539b5f2bd3025198504/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.729076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d921c8d80fa946ea9080413332b5afaa, user_id=2471729723fe4539b5f2bd3025198504, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.733412 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.757685 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1395/2781] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:05 2022] PUT /identity/v3/projects/d921c8d80fa946ea9080413332b5afaa/users/2471729723fe4539b5f2bd3025198504/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:05.762135 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.779639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744c95-e43e-4d30-a6bc-7fd39c9afba9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.856262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:05.877221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.878176 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.878461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.878936 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.879679 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.881286 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e518-4198-47c9-bb97-80dbda1e5d77 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.898004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1387/2782] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:05.902741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:05.914481 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d713c6-f1e6-4a69-9e6e-21dc9cf83088 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:05.920076 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:05.920765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:05.921083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:05.921356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] PATH_INFO: `/v3/projects/d921c8d80fa946ea9080413332b5afaa/users/2471729723fe4539b5f2bd3025198504/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:05.923467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d921c8d80fa946ea9080413332b5afaa, user_id=2471729723fe4539b5f2bd3025198504, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:05.926149 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:05.941248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1396/2783] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:05 2022] PUT /identity/v3/projects/d921c8d80fa946ea9080413332b5afaa/users/2471729723fe4539b5f2bd3025198504/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:11.757739 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c097ea-6183-46ce-9eba-aef2a72d5ba3 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:11.758390 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c097ea-6183-46ce-9eba-aef2a72d5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:11.758553 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c097ea-6183-46ce-9eba-aef2a72d5ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:11.791745 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-01c097ea-6183-46ce-9eba-aef2a72d5ba3 None None] MFA Rules not processed for user `2471729723fe4539b5f2bd3025198504`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:11.792887 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-01c097ea-6183-46ce-9eba-aef2a72d5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:11.887153 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1388/2784] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:11.896088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:11.897922 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:11.992666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e52e0-f44a-4788-bc9e-bc5d7f834326 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:11.996415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2579707a174cd3ba2d235e6ec548bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:11.997042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:11.997329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:11.997608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:12.025974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:12.064676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:12.066224 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:12.076290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1397/2785] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:12.208056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:12.208400 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:12.208689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:12.265785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:12.267020 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:12.334849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1389/2786] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:12.379860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:12.381284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:12.485072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a99d-215f-4915-91a2-99e0246ea2f1 service glance] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:12.491066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:12.491716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:12.492719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:12.493003 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:12.514841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:12.514841 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:12.528398 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1398/2787] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:04:15.021021 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:15.030903 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:15.098188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:15.117357 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a399-d69b-45e9-90d7-8f285b2b36fb None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:15.123225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:15.123812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:15.124565 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:15.124762 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:15.129003 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:15.216932 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:15.218566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:15.231979 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1390/2788] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:18.798123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:18.799698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:18.825996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc811-b448-4bcb-bb25-46caf68f6737 service swift] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:18.834005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:18.834684 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:18.835247 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:18.835532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] PATH_INFO: `/v3/users/de93d70b46e6422f8aeb1effc49b02ef` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:18.836759 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de93d70b46e6422f8aeb1effc49b02ef)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:18.846396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:18.920605 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de93d70b46e6422f8aeb1effc49b02ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:18.922016 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de93d70b46e6422f8aeb1effc49b02ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:18.926618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de93d70b46e6422f8aeb1effc49b02ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:18.959107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de93d70b46e6422f8aeb1effc49b02ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:18.967891 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-8e91bd9f-6bfe-46a6-a26e-e94076a43892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de93d70b46e6422f8aeb1effc49b02ef'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:18.987868 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1399/2789] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:18 2022] DELETE /identity/v3/users/de93d70b46e6422f8aeb1effc49b02ef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:19.223555 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.236219 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7aa75-046f-48e6-81fe-117694af90c8 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.337441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.338132 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.338414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.338690 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] PATH_INFO: `/v3/projects/d0060428cb5d4f9c89471d82aacd392c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.339874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0060428cb5d4f9c89471d82aacd392c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.341826 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.401106 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0060428cb5d4f9c89471d82aacd392c', 'request_id': 'req-962195ca-bac8-423c-b0b8-3816b53a33f4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:19.412962 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0060428cb5d4f9c89471d82aacd392c', 'request_id': 'req-962195ca-bac8-423c-b0b8-3816b53a33f4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:19.422426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0060428cb5d4f9c89471d82aacd392c', 'request_id': 'req-962195ca-bac8-423c-b0b8-3816b53a33f4'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:19.439960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] The token cache is being invalidate because project d0060428cb5d4f9c89471d82aacd392c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:19.440561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:19.441444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-962195ca-bac8-423c-b0b8-3816b53a33f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:19.446896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1391/2790] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:19 2022] DELETE /identity/v3/projects/d0060428cb5d4f9c89471d82aacd392c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:19.449642 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.450043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.450325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.481986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:19.483846 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:19.489032 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:19.581523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1400/2791] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:19.583295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.583583 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.583881 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.611327 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:19.612776 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:19.632747 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.641851 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1392/2792] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:19.644295 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143ef14-02f4-44e2-abfc-051cf6647718 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.654164 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.656256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.656732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.657234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.658196 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:04:19.658711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.660569 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.682054 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1401/2793] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:04:19.687548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.702282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2052bc-8a36-4dd6-9f91-7ec0b76e9602 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.707660 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.708403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.708691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.709063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.709744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.711702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.732640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:19.757652 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1393/2794] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:19 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:19.758709 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.776259 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76be4a-ffb0-469d-9181-7365b02e9bd9 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.856772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.857492 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.857672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.857986 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.859317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.861387 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.891741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1402/2795] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:19 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:19.893073 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.909019 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c6d7-b03b-451a-8059-aad44cdb8805 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.914156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.914991 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.915440 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.915882 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.916896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.919787 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.935051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1394/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:19.939577 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.951705 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149d07-a9aa-4129-b4a3-c5daf7704e9e admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.957765 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.958433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.958724 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.959009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:19.959844 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:19.961330 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dede1da-da83-4632-b0ef-c4aefc7b8758 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:19.974179 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1403/2797] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:19.979185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:19.991237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbe7d-1e9e-47a3-be8e-509e1def3ad7 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:19.996044 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:19.996715 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:19.997000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:19.997279 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] PATH_INFO: `/v3/projects/74f6d8b4fb9244548c0194ed0e194910/users/008059f0036441b1b5bb9bf206f4e03c/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.015394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f6d8b4fb9244548c0194ed0e194910, user_id=008059f0036441b1b5bb9bf206f4e03c, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.018994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.047841 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1395/2798] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:19 2022] PUT /identity/v3/projects/74f6d8b4fb9244548c0194ed0e194910/users/008059f0036441b1b5bb9bf206f4e03c/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:20.049713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.050031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.050325 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.081664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] MFA Rules not processed for user `008059f0036441b1b5bb9bf206f4e03c`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:20.083427 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:20.165200 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1404/2799] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:20.169389 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.241713 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2891-c029-4d31-8d93-b5b86c42ec0b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.247686 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.248308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.250057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.250057 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.250888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.252807 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.292009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1396/2800] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:20 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:20.296863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.303875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:20.311126 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dbcde-a8f8-456e-8ee0-b43e40ad4196 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.385902 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.386585 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.387072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.387444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.388165 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.392088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.420151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1405/2801] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:20 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:20.422369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.433643 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484804-f52c-436a-be15-12027dfb9a18 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.438702 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.439312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.439590 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.439888 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.440581 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.442188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.457200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1397/2802] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:20.461245 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.473317 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb555-6f42-4cd7-a993-1edbad5cb47f admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.478354 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.479139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.479430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.479716 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] PATH_INFO: `/v3/projects/0931079d69644b0ba39cb077812c65aa/users/91624b9b56eb43d08cdea0ada57fa795/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.500284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0931079d69644b0ba39cb077812c65aa, user_id=91624b9b56eb43d08cdea0ada57fa795, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.502925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.521683 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1406/2803] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:20 2022] PUT /identity/v3/projects/0931079d69644b0ba39cb077812c65aa/users/91624b9b56eb43d08cdea0ada57fa795/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:20.522855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.535896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395676-f9cf-4ba6-9bc0-0406e433ffa9 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.610604 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.611751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.612069 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.612310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.613009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.614628 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c9ebf-7ef3-43bc-b9f5-b6ac8099a813 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.628924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1398/2804] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:20.632822 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.646621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffda-676a-4a6a-970a-c26c8d517c89 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.651626 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.652306 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.652596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.652878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] PATH_INFO: `/v3/projects/0931079d69644b0ba39cb077812c65aa/users/91624b9b56eb43d08cdea0ada57fa795/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.655511 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0931079d69644b0ba39cb077812c65aa, user_id=91624b9b56eb43d08cdea0ada57fa795, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.658442 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.672188 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1407/2805] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:20 2022] PUT /identity/v3/projects/0931079d69644b0ba39cb077812c65aa/users/91624b9b56eb43d08cdea0ada57fa795/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:20.682231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.682561 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.682799 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.720928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] MFA Rules not processed for user `91624b9b56eb43d08cdea0ada57fa795`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:20.722445 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:20.745448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:20.808548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1399/2806] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:20.822508 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:20.828088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:20.896172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf9f5-feaf-4f88-a80b-b3e98900b8e0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:20.901288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:20.902063 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:20.902457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:20.902834 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:20.976005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:20.977471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa12bd6-189a-46fe-98be-6aeb47d62470 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:20.988761 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1408/2807] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:22.427964 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:22.429432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:22.442779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42440e-91ed-4176-b7e9-c2034d0fdcef None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:22.446348 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:22.447049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:22.447233 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:22.447511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:22.456819 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:22.458273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151c454-3d75-4a7e-ae3c-df88133ea297 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:22.468299 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1400/2808] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:22.486957 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:22.487422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:22.487565 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:22.508009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] MFA Rules not processed for user `f1409edcf43240ee83460037d78ece2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:22.509218 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:22.514371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:22.567890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1409/2809] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:24.386386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:24.386864 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:24.386963 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:24.406337 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:24.407535 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:24.463855 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1401/2810] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Jul 26 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:24.478002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:24.479673 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:24.556047 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d182705-f9f0-4460-82bd-d58b359fd9a1 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:24.561145 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:24.562316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:24.562600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:24.562880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:24.571503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:24.573095 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a03fb-74f4-46d3-858d-f1d1bf621fb0 service swift] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:24.581745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1410/2811] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:04:26.275909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:26.345669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2d2cd-88cb-4a13-9712-2c88546159ba None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:26.350314 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:26.350984 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:26.351269 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:26.351570 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] PATH_INFO: `/v3/users/008059f0036441b1b5bb9bf206f4e03c` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:26.352752 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008059f0036441b1b5bb9bf206f4e03c)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:26.354729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:26.408284 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008059f0036441b1b5bb9bf206f4e03c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:26.410863 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:26.417481 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008059f0036441b1b5bb9bf206f4e03c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:26.418496 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008059f0036441b1b5bb9bf206f4e03c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:26.430311 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008059f0036441b1b5bb9bf206f4e03c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:26.446603 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008059f0036441b1b5bb9bf206f4e03c'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:26.453303 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1402/2812] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:26 2022] DELETE /identity/v3/users/008059f0036441b1b5bb9bf206f4e03c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:26.457764 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895506-635c-469e-9944-291140c78193 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:26.458351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895506-635c-469e-9944-291140c78193 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:26.458351 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895506-635c-469e-9944-291140c78193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:26.479369 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c1895506-635c-469e-9944-291140c78193 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:26.480523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c1895506-635c-469e-9944-291140c78193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:26.562518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1411/2813] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:26.569170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:26.572033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:26.654293 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e29a4c-1ab1-494e-b9ab-56a3b2cb1392 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:26.659125 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:26.659751 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:26.660033 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:26.660312 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:26.686707 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:26.689297 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:26.700700 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1403/2814] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:27.068430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895506-635c-469e-9944-291140c78193 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:27.069970 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c1895506-635c-469e-9944-291140c78193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:27.084252 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895506-635c-469e-9944-291140c78193 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:27.103704 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:27.104646 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:27.105982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:27.106901 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] PATH_INFO: `/v3/projects/74f6d8b4fb9244548c0194ed0e194910` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:27.111051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f6d8b4fb9244548c0194ed0e194910)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:27.113287 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:27.160770 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:27.169867 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f6d8b4fb9244548c0194ed0e194910', 'request_id': 'req-967fc0a9-d534-413e-8ec3-e4d173aab6c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.178075 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f6d8b4fb9244548c0194ed0e194910', 'request_id': 'req-967fc0a9-d534-413e-8ec3-e4d173aab6c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.187886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f6d8b4fb9244548c0194ed0e194910', 'request_id': 'req-967fc0a9-d534-413e-8ec3-e4d173aab6c0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.199318 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] The token cache is being invalidate because project 74f6d8b4fb9244548c0194ed0e194910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:27.199612 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.200248 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.202439 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1412/2815] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:27 2022] DELETE /identity/v3/projects/74f6d8b4fb9244548c0194ed0e194910 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:27.206454 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:27.216300 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eaac4-8cc8-4bf6-a8a5-b909c1bc1a97 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:27.290778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:27.291671 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:27.292056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:27.292436 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] PATH_INFO: `/v3/users/91624b9b56eb43d08cdea0ada57fa795` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:27.293782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91624b9b56eb43d08cdea0ada57fa795)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:27.296698 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:27.350533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91624b9b56eb43d08cdea0ada57fa795'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.359503 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91624b9b56eb43d08cdea0ada57fa795'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.360114 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91624b9b56eb43d08cdea0ada57fa795'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.369065 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91624b9b56eb43d08cdea0ada57fa795'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.377025 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:27.384109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-9b460911-e927-4388-a930-56039e3d9d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91624b9b56eb43d08cdea0ada57fa795'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.393451 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1404/2816] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:27 2022] DELETE /identity/v3/users/91624b9b56eb43d08cdea0ada57fa795 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:27.697417 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:27.698896 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:27.713443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc0a9-d534-413e-8ec3-e4d173aab6c0 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:27.820791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:27.821706 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:27.822311 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:27.822823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] PATH_INFO: `/v3/projects/0931079d69644b0ba39cb077812c65aa` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:27.825856 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0931079d69644b0ba39cb077812c65aa)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:27.829279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:27.907099 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0931079d69644b0ba39cb077812c65aa', 'request_id': 'req-4ea658df-35ef-40eb-81f8-eb90935e1b98'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.915989 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0931079d69644b0ba39cb077812c65aa', 'request_id': 'req-4ea658df-35ef-40eb-81f8-eb90935e1b98'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.926784 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0931079d69644b0ba39cb077812c65aa', 'request_id': 'req-4ea658df-35ef-40eb-81f8-eb90935e1b98'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.942640 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] The token cache is being invalidate because project 0931079d69644b0ba39cb077812c65aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:27.942945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.943607 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-4ea658df-35ef-40eb-81f8-eb90935e1b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:27.948482 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1413/2817] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:27 2022] DELETE /identity/v3/projects/0931079d69644b0ba39cb077812c65aa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:27.950986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:27.951345 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:27.952331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:27.982004 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:27.983773 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:28.061771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1405/2818] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:28.071027 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d814a-2355-408b-a718-8b4962732541 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.071234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d814a-2355-408b-a718-8b4962732541 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.071516 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d814a-2355-408b-a718-8b4962732541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.094470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-130d814a-2355-408b-a718-8b4962732541 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:28.095776 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-130d814a-2355-408b-a718-8b4962732541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:28.105031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1414/2819] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:28.109306 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.119788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adadc87-6da2-4771-adb0-b203a765e27b None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.125140 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.125758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.126077 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.126354 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.127056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:04:28.127359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.128949 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.142432 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1406/2820] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 13:04:28.146797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d814a-2355-408b-a718-8b4962732541 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.157168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d814a-2355-408b-a718-8b4962732541 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.162613 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.163356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.163711 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.164118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.164863 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.167139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.198125 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1415/2821] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:28.202703 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.216406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada18b4-4aef-409b-8e82-7ebbcf5ba792 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.280235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.280909 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.281259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.281562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.282310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.284324 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.309051 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1407/2822] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:04:28.313945 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.325518 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5401446-761d-4e03-9d7a-8b5f6a23a60d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.330503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.331124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.331411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.331693 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.332394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.334034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.345599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1416/2823] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:28.349761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.361320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7c8a-5d95-4b1e-af68-c6c63dbd6dba admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.366585 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.367128 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.367418 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.367695 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.368404 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.374850 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ef69-3fa7-4cd7-9ba7-5b65a3e9198e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.386564 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1408/2824] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:28.391151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.401745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d3f-cbde-4f3d-8a8b-3e8000199e25 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.406847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.407651 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.408039 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.408422 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] PATH_INFO: `/v3/projects/455ca0ffd9c34f569a0ccf23c2e966d5/users/b016feb180dd46509a311aaafcebcb7f/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.425119 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455ca0ffd9c34f569a0ccf23c2e966d5, user_id=b016feb180dd46509a311aaafcebcb7f, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.427974 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.432017 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:28.451329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1417/2825] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:28 2022] PUT /identity/v3/projects/455ca0ffd9c34f569a0ccf23c2e966d5/users/b016feb180dd46509a311aaafcebcb7f/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:28.461866 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.462262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.462636 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.494967 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] MFA Rules not processed for user `b016feb180dd46509a311aaafcebcb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:28.496188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:28.544533 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:28.573546 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1409/2826] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:28.579510 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.647972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38adf78-9f9f-4d5b-91d3-cc1fe19d1191 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.653471 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.654219 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.654677 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.655028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.655860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.658083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.687334 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1418/2827] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:04:28.691544 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.704731 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a43585-b847-4fd9-b2d7-58d9f02e518c None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.769097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.770066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.770514 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.770956 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.771796 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.773920 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.801027 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1410/2828] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:28 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:28.802358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.814209 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff12317-69bd-44b3-b2f6-85884e577af7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.818959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.819590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.819877 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.820299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.821007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.822662 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.834864 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1419/2829] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:28.839171 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.856190 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73021d88-e462-46a9-850d-24816be2bd4a admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.861249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.862054 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.862405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.862859 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] PATH_INFO: `/v3/projects/b9da54142f014ef89a798fbc33d2c507/users/e8b3a5fdf85941c0a929cc9b4078e7a0/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.884548 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9da54142f014ef89a798fbc33d2c507, user_id=e8b3a5fdf85941c0a929cc9b4078e7a0, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.887358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:28.909230 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:28.909678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1411/2830] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:28 2022] PUT /identity/v3/projects/b9da54142f014ef89a798fbc33d2c507/users/e8b3a5fdf85941c0a929cc9b4078e7a0/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:28.919621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4d107-01a8-4862-b9a9-9d973363e7e3 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:28.987370 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:28.988011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:28.988303 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:28.988579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:28.989292 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:28.991279 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cad65-5fc6-4a78-95da-dddbf5b9926f admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:29.003028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1420/2831] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:29.007446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:29.018149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae56e2-5d9f-49d3-86be-60a9de86b29b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:29.027770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:29.028601 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.028981 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.029335 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] PATH_INFO: `/v3/projects/b9da54142f014ef89a798fbc33d2c507/users/e8b3a5fdf85941c0a929cc9b4078e7a0/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.031516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9da54142f014ef89a798fbc33d2c507, user_id=e8b3a5fdf85941c0a929cc9b4078e7a0, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:29.034185 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:29.056042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1412/2832] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:29 2022] PUT /identity/v3/projects/b9da54142f014ef89a798fbc33d2c507/users/e8b3a5fdf85941c0a929cc9b4078e7a0/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:29.058022 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.058489 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.058967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.100205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] MFA Rules not processed for user `e8b3a5fdf85941c0a929cc9b4078e7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:29.101608 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:29.208925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:29.233971 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1421/2833] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:29.244694 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:29.246446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:29.312827 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac00a27-5837-4801-b95f-35a43085671e admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:29.316675 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:29.317332 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.317616 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.317924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.327895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:29.329349 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b91b1-ec80-48be-8f07-51fe2ec84ec3 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:29.340227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1413/2834] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:29.418469 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:29.494676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76494fd-b7a9-4a96-82f8-15c33ca29871 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:29.499820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:29.500474 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.500762 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.501044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] PATH_INFO: `/v3/users/b016feb180dd46509a311aaafcebcb7f` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.502310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b016feb180dd46509a311aaafcebcb7f)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:29.504256 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:29.556424 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b016feb180dd46509a311aaafcebcb7f'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:29.557192 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b016feb180dd46509a311aaafcebcb7f'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:29.557894 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b016feb180dd46509a311aaafcebcb7f'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:29.571273 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b016feb180dd46509a311aaafcebcb7f'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:29.578829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b016feb180dd46509a311aaafcebcb7f'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:29.593030 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1422/2835] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:29 2022] DELETE /identity/v3/users/b016feb180dd46509a311aaafcebcb7f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:29.598042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.598334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.598612 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.619414 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:29.620642 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:29.668942 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:29.709159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1414/2836] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:29.721020 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:29.722889 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:29.798847 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486370-f966-4c6b-9ce5-7790bc821fa7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:29.803917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:29.804763 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:29.804942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:29.805172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:29.815900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:29.817346 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:29.830530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1423/2837] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:30.128943 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:30.130689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:30.172693 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfdc01-4fdd-4baf-a4af-050682a43661 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:30.177789 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:30.178461 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:30.178741 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:30.179042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] PATH_INFO: `/v3/projects/455ca0ffd9c34f569a0ccf23c2e966d5` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:30.180211 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455ca0ffd9c34f569a0ccf23c2e966d5)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:30.182151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:30.236986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455ca0ffd9c34f569a0ccf23c2e966d5', 'request_id': 'req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.251515 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455ca0ffd9c34f569a0ccf23c2e966d5', 'request_id': 'req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.264794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455ca0ffd9c34f569a0ccf23c2e966d5', 'request_id': 'req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.281122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] The token cache is being invalidate because project 455ca0ffd9c34f569a0ccf23c2e966d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:30.282257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.282392 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.285178 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1415/2838] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:30 2022] DELETE /identity/v3/projects/455ca0ffd9c34f569a0ccf23c2e966d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:30.289624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:30.304618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816e3d-d91a-4648-a046-d51f0da08ccf service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:30.349046 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:30.439917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:30.441042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:30.441397 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:30.441757 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] PATH_INFO: `/v3/users/e8b3a5fdf85941c0a929cc9b4078e7a0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:30.443924 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b3a5fdf85941c0a929cc9b4078e7a0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:30.446392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:30.512990 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b3a5fdf85941c0a929cc9b4078e7a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.513665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b3a5fdf85941c0a929cc9b4078e7a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.514352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b3a5fdf85941c0a929cc9b4078e7a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.527101 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b3a5fdf85941c0a929cc9b4078e7a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.535136 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-b6eeb767-161e-4ff4-86c8-01f1a8fbad29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b3a5fdf85941c0a929cc9b4078e7a0'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:30.555394 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1424/2839] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:30 2022] DELETE /identity/v3/users/e8b3a5fdf85941c0a929cc9b4078e7a0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:31.159028 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.160662 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:31.184009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0ce2a-2fd4-489a-ae28-06fbda4c0b93 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.268709 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.269500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.269911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.270188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] PATH_INFO: `/v3/projects/b9da54142f014ef89a798fbc33d2c507` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.271378 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9da54142f014ef89a798fbc33d2c507)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.273397 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.327456 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9da54142f014ef89a798fbc33d2c507', 'request_id': 'req-7c3bef37-b151-40bf-876f-d6f841cdcaef'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:31.336259 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9da54142f014ef89a798fbc33d2c507', 'request_id': 'req-7c3bef37-b151-40bf-876f-d6f841cdcaef'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:31.344386 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9da54142f014ef89a798fbc33d2c507', 'request_id': 'req-7c3bef37-b151-40bf-876f-d6f841cdcaef'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:31.346221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:31.361329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] The token cache is being invalidate because project b9da54142f014ef89a798fbc33d2c507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:31.361716 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:31.362467 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-7c3bef37-b151-40bf-876f-d6f841cdcaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:31.368017 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1416/2840] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:31 2022] DELETE /identity/v3/projects/b9da54142f014ef89a798fbc33d2c507 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:31.369634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.370208 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.370333 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.392302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:31.393544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:31.465880 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1425/2841] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:31.526126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.526126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.526126 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.549274 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:31.550666 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:31.567042 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1417/2842] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:31.571234 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.585143 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a712-150f-4619-92a7-0ed269a1baa5 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.597732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.598429 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.598723 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.599009 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.599727 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:04:31.600043 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.601665 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.638060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1426/2843] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:04:31.642579 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.657749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7a681-0d68-416d-bff9-d7b1feb729d6 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.678320 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.678847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.679280 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.679600 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.680261 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.682201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.713092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1418/2844] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:31 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:31.718555 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.738128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae823-7354-45b4-95fe-5b97ceec8f25 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.763428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:31.807264 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.807886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.808170 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.808451 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.809118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.811782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.834575 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1427/2845] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:31 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:31.838718 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.849904 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9185fb-cf03-4d3f-ad84-fc6b6efe915b admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.855070 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.855758 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.856124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.856466 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.857229 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.858957 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.869691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1419/2846] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:31.874328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.884719 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d22a-a2bc-45ba-a064-4a0e633c2780 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.890068 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.890778 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.891128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.891487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.892254 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.894031 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9ab51-bf95-4fb1-900f-9d4e08f560e3 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.904586 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1428/2847] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:31.908931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:31.919701 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd9d49-a9a9-448b-b83d-3da7f7547173 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:31.924307 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:31.924969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.925249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.925519 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] PATH_INFO: `/v3/projects/61d0a8c421174150a088abe8632faa9d/users/c66d2ac190e84e08a1f6674fe8865634/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:31.941200 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d0a8c421174150a088abe8632faa9d, user_id=c66d2ac190e84e08a1f6674fe8865634, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:31.943873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:31.962272 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1420/2848] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:31 2022] PUT /identity/v3/projects/61d0a8c421174150a088abe8632faa9d/users/c66d2ac190e84e08a1f6674fe8865634/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:04:31.972963 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:31.973168 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:31.974072 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.004121 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] MFA Rules not processed for user `c66d2ac190e84e08a1f6674fe8865634`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:32.005356 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:32.069670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1429/2849] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:32.074149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.138164 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b94-6884-4376-a963-fda692e30673 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.143157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.143767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.144046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.144347 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.145045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.147009 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.173250 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1421/2850] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:32.177383 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.189028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c21b-e724-48f6-b98d-9e2a17d09573 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.244242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.244782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.245062 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.245337 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.246087 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.247998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.268983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1430/2851] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:32.272994 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.283172 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f2a0-3d2b-4170-80e5-8efe17b208ca admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.287687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.288285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.288562 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.288834 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.289516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.291121 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.302063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1422/2852] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:32.305825 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.316530 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96d75-1293-47ed-a720-43933ea4e74d admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.321071 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.321670 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.321992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.322271 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.322959 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.324527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a145-8fcd-46e3-b66d-bd9e31209f48 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.334786 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1431/2853] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:32.338755 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.348629 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b1a0-0912-4ecd-86ef-ce1975866a09 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.353108 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.353770 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.354064 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.354338 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] PATH_INFO: `/v3/projects/5b073543a14c4f6988ff0fce1adb6c8d/users/d6fb90358502434688e6a4ef2b4af803/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.370058 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b073543a14c4f6988ff0fce1adb6c8d, user_id=d6fb90358502434688e6a4ef2b4af803, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.372736 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.385876 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1423/2854] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:32 2022] PUT /identity/v3/projects/5b073543a14c4f6988ff0fce1adb6c8d/users/d6fb90358502434688e6a4ef2b4af803/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:04:32.397396 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.397967 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.398078 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.412249 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:32.426928 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] MFA Rules not processed for user `d6fb90358502434688e6a4ef2b4af803`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:32.428161 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:32.491579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1432/2855] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:32.496166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.538122 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:32.559446 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e18a-a642-402a-850c-0fb5b0f7abcd admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.564251 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.564861 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.565147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.565426 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.566141 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.568039 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.594302 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1424/2856] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:32.598479 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.610056 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce28ce-6af0-4eaf-b870-8461c0584799 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.665595 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.666240 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.666523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.666798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] PATH_INFO: `/v3/users` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.667454 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.669365 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.694243 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1433/2857] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:32.695441 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.706677 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe79344-c068-4317-a524-41837883ffa1 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.711358 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.711969 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.712252 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.712525 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.713212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.714828 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.726242 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1425/2858] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:32.730299 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.741972 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262ac0-6b8a-44a1-9d09-36147a7e54fa admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.750176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.750807 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.751066 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.751340 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] PATH_INFO: `/v3/projects/387ee9b7aca24d04b5c1fce2158eb279/users/6c9653ad3d8a483eb5266b0f695b9fb5/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.768090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387ee9b7aca24d04b5c1fce2158eb279, user_id=6c9653ad3d8a483eb5266b0f695b9fb5, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.770812 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.784760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1434/2859] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:32 2022] PUT /identity/v3/projects/387ee9b7aca24d04b5c1fce2158eb279/users/6c9653ad3d8a483eb5266b0f695b9fb5/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:32.788664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.798854 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78132218-8935-4625-93ee-4a846d29b1e1 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.858395 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.859123 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.859511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.859890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.860687 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.862363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295348c-da10-45a0-97ce-9e0c1b14261b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.872568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1426/2860] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 13:04:32.876969 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:32.887151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947524b1-bc1c-4c60-9407-c0a0c293bfb2 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:32.892588 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:32.893242 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.893527 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.893829 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] PATH_INFO: `/v3/projects/387ee9b7aca24d04b5c1fce2158eb279/users/6c9653ad3d8a483eb5266b0f695b9fb5/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.895789 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387ee9b7aca24d04b5c1fce2158eb279, user_id=6c9653ad3d8a483eb5266b0f695b9fb5, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:32.898462 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:32.909176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1435/2861] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:32 2022] PUT /identity/v3/projects/387ee9b7aca24d04b5c1fce2158eb279/users/6c9653ad3d8a483eb5266b0f695b9fb5/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:32.919040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:32.919331 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:32.919610 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:32.947540 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] MFA Rules not processed for user `6c9653ad3d8a483eb5266b0f695b9fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:32.948768 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:33.019997 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1427/2862] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:33.031100 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:33.032813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:33.086341 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:33.091618 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572d5e-bc75-44dd-af01-044b834fbfb7 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:33.096328 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:33.096942 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:33.097223 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:33.097498 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:33.106602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:33.108051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:33.117558 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1436/2863] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:33.609668 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:33.611137 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:33.624353 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be1d77-8b7a-4e8f-9711-8430ae939aae None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:33.627897 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:33.628500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:33.628775 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:33.629047 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:33.662158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:33.687356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:33.688791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:33.697847 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1428/2864] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:37.728452 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:37.738044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6549e-4467-4448-9244-9e6b2ced1b36 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:37.741921 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:37.742533 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:37.742813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:37.743088 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:37.800122 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:37.801621 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc10d-8a5d-41a7-b687-e942155ef0f6 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:37.810806 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1437/2865] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:39.882958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:39.948916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221af3-e439-44c6-8fdd-01b866ec5763 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:39.955098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:39.955966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:39.956372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:39.956659 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] PATH_INFO: `/v3/users/c66d2ac190e84e08a1f6674fe8865634` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:39.958023 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66d2ac190e84e08a1f6674fe8865634)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:39.959977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:40.006654 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66d2ac190e84e08a1f6674fe8865634'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.013744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66d2ac190e84e08a1f6674fe8865634'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.015031 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66d2ac190e84e08a1f6674fe8865634'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.022310 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66d2ac190e84e08a1f6674fe8865634'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.034231 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66d2ac190e84e08a1f6674fe8865634'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.040262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1429/2866] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:39 2022] DELETE /identity/v3/users/c66d2ac190e84e08a1f6674fe8865634 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:40.044739 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:40.045197 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:40.045348 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:40.066233 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:40.067444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:40.127194 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1438/2867] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:40.136777 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:40.138212 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:40.195408 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec910be-6af8-4262-818c-7298a62b9491 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:40.199000 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:40.199608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:40.199890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:40.200166 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:40.207945 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:40.210403 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:40.212112 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:40.225977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1430/2868] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:40.490298 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:40.491736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:40.504367 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e46e63-1fcd-4c67-885c-66eecd7772d8 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:40.509090 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:40.509733 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:40.510048 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:40.510329 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] PATH_INFO: `/v3/projects/61d0a8c421174150a088abe8632faa9d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:40.511505 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d0a8c421174150a088abe8632faa9d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:40.513449 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:40.560434 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d0a8c421174150a088abe8632faa9d', 'request_id': 'req-7037bc14-27fd-4780-a06d-5032170b6450'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.567343 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d0a8c421174150a088abe8632faa9d', 'request_id': 'req-7037bc14-27fd-4780-a06d-5032170b6450'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.574266 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d0a8c421174150a088abe8632faa9d', 'request_id': 'req-7037bc14-27fd-4780-a06d-5032170b6450'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.585139 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] The token cache is being invalidate because project 61d0a8c421174150a088abe8632faa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:40.585428 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.586083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.587619 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1439/2869] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:40 2022] DELETE /identity/v3/projects/61d0a8c421174150a088abe8632faa9d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:40.591606 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:40.601183 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee4471-e347-4b4b-83aa-02adb3bdfd62 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:40.657532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:40.658124 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:40.658405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:40.658678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] PATH_INFO: `/v3/users/d6fb90358502434688e6a4ef2b4af803` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:40.659825 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fb90358502434688e6a4ef2b4af803)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:40.661727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:40.712614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fb90358502434688e6a4ef2b4af803'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.720771 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fb90358502434688e6a4ef2b4af803'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.721420 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fb90358502434688e6a4ef2b4af803'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.728283 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fb90358502434688e6a4ef2b4af803'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.741049 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fb90358502434688e6a4ef2b4af803'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:40.746840 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1431/2870] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:40 2022] DELETE /identity/v3/users/d6fb90358502434688e6a4ef2b4af803 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:41.040672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:41.045996 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:41.060925 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc14-27fd-4780-a06d-5032170b6450 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:41.072205 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:41.130751 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:41.131496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.131781 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.132060 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] PATH_INFO: `/v3/projects/5b073543a14c4f6988ff0fce1adb6c8d` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.133239 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b073543a14c4f6988ff0fce1adb6c8d)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:41.135557 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:41.182491 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b073543a14c4f6988ff0fce1adb6c8d', 'request_id': 'req-0c7485c2-c6fb-40aa-95e3-b53d11064253'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.189529 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b073543a14c4f6988ff0fce1adb6c8d', 'request_id': 'req-0c7485c2-c6fb-40aa-95e3-b53d11064253'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.196374 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b073543a14c4f6988ff0fce1adb6c8d', 'request_id': 'req-0c7485c2-c6fb-40aa-95e3-b53d11064253'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.206752 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] The token cache is being invalidate because project 5b073543a14c4f6988ff0fce1adb6c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:41.207044 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.207664 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.209171 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1440/2871] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:41 2022] DELETE /identity/v3/projects/5b073543a14c4f6988ff0fce1adb6c8d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:41.213105 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:41.214551 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:41.227188 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130ca1-b316-4896-bd55-57067c62fd55 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:41.284158 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:41.284794 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.285074 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.285346 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] PATH_INFO: `/v3/users/6c9653ad3d8a483eb5266b0f695b9fb5` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.286512 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9653ad3d8a483eb5266b0f695b9fb5)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:41.288394 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:41.304450 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:41.334369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9653ad3d8a483eb5266b0f695b9fb5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.341593 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9653ad3d8a483eb5266b0f695b9fb5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.342356 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9653ad3d8a483eb5266b0f695b9fb5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.349655 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9653ad3d8a483eb5266b0f695b9fb5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.362068 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-1f68033c-47de-43cf-85c0-7900a5f46e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9653ad3d8a483eb5266b0f695b9fb5'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.368189 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1432/2872] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:04:41 2022] DELETE /identity/v3/users/6c9653ad3d8a483eb5266b0f695b9fb5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:41.641982 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:41.643866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:41.658446 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7485c2-c6fb-40aa-95e3-b53d11064253 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:41.716094 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:41.716745 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.717173 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.717457 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] PATH_INFO: `/v3/projects/387ee9b7aca24d04b5c1fce2158eb279` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.718645 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387ee9b7aca24d04b5c1fce2158eb279)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:41.720537 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:41.764053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:41.767436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387ee9b7aca24d04b5c1fce2158eb279', 'request_id': 'req-bee5f198-26f8-4a9f-9c9c-331f8bea2896'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.774470 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387ee9b7aca24d04b5c1fce2158eb279', 'request_id': 'req-bee5f198-26f8-4a9f-9c9c-331f8bea2896'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.782115 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387ee9b7aca24d04b5c1fce2158eb279', 'request_id': 'req-bee5f198-26f8-4a9f-9c9c-331f8bea2896'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.792426 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] The token cache is being invalidate because project 387ee9b7aca24d04b5c1fce2158eb279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:04:41.792713 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.793415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-bee5f198-26f8-4a9f-9c9c-331f8bea2896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:04:41.795463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1441/2873] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:04:41 2022] DELETE /identity/v3/projects/387ee9b7aca24d04b5c1fce2158eb279 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:41.802566 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.802858 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.803134 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.823006 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:41.824201 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:41.882682 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1433/2874] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:41.891277 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.891678 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.891962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.912053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:41.913291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:41.922130 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1442/2875] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:41.926381 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:41.936960 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdec1c-22d0-4e68-a7b8-31db1823b4e8 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:41.941448 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:41.942078 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.942364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.942639 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.943334 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:04:41.943667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:41.945218 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:41.958056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1434/2876] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:04:41.962593 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:41.972055 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f8e47-7d82-458d-ae39-3867f31a6c61 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:41.976695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:41.977293 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:41.977579 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:41.977886 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:41.978552 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:41.980437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.008732 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1443/2877] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:41 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:42.012812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:42.022805 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5eebc-9abd-41ce-a8ed-2db9ab154e49 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:42.080147 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:42.080764 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.081043 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.081319 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.082005 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:42.083896 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.104485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1435/2878] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:42 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:42.109443 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:42.120176 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ce9b-c87a-4085-91e2-30055b70d805 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:42.125536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:42.126182 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.126467 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.126746 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.127440 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:42.129025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.140927 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1444/2879] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:42.143157 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:42.153156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81914-de61-4839-8b59-02cb489f0bf7 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:42.158329 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:42.158928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.159209 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.159482 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.160177 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:42.161749 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1f564-add2-424b-af1b-8ef5c82f8d8b admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.167142 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:42.179136 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1436/2880] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:42.182487 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:42.194473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57bbb-3073-4b28-b59e-089d3b674054 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:42.200288 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:42.200983 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.201305 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.202023 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] PATH_INFO: `/v3/projects/b969065d7434469a941152fde54433e5/users/66b1b6c5e337437c98e39bca152be598/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.217668 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b969065d7434469a941152fde54433e5, user_id=66b1b6c5e337437c98e39bca152be598, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:42.220371 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.234875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1445/2881] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:42 2022] PUT /identity/v3/projects/b969065d7434469a941152fde54433e5/users/66b1b6c5e337437c98e39bca152be598/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:04:42.240282 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ab36-6550-4617-bf09-e52b8aa60fb8 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.240788 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ab36-6550-4617-bf09-e52b8aa60fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.240902 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ab36-6550-4617-bf09-e52b8aa60fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.260767 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-d1d1ab36-6550-4617-bf09-e52b8aa60fb8 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:42.262010 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d1d1ab36-6550-4617-bf09-e52b8aa60fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:42.323712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1437/2882] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:04:42.333614 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:42.335358 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:42.391973 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cab55-5775-42ab-b012-afe2d84c866a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:42.395744 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:42.396352 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:42.396634 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:42.396913 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:42.406284 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:42.407788 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:42.416938 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1446/2883] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:43.086602 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.086944 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.087198 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.120292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] MFA Rules not processed for user `66b1b6c5e337437c98e39bca152be598`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:43.121573 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:43.203536 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1438/2884] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:43.208237 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.219084 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d07e-5f54-46eb-982d-abdc3236c3e7 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.223809 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.224430 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.224998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.224998 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.225663 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.227675 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.257666 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1447/2885] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:43.261680 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.273849 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5967c36-d530-4a2b-8eaa-466bf06365a4 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.330402 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.331012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.331292 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.331567 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.332228 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.334139 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.354779 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1439/2886] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:04:43 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:04:43.359553 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.371444 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793339c7-2810-44f3-9934-6d6d07ac4c5b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.376820 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.377437 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.377860 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.378146 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.378992 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.380570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.391587 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1448/2887] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:43.395812 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.405947 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994741-6d19-4101-83ba-b32e0d79cef4 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.410661 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.411326 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.411608 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.411886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] PATH_INFO: `/v3/projects/05443568109c4fdebb8b1a221f8363c3/users/d7f80cc027654e97bafa216b2bcd70c8/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.427800 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=05443568109c4fdebb8b1a221f8363c3, user_id=d7f80cc027654e97bafa216b2bcd70c8, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.430537 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.433689 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:43.447527 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1440/2888] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:43 2022] PUT /identity/v3/projects/05443568109c4fdebb8b1a221f8363c3/users/d7f80cc027654e97bafa216b2bcd70c8/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:43.451654 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.462002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd8df-efa4-4160-97ab-8f5279e095c5 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.500570 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:43.523214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.523875 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.524163 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.524448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.525151 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.526777 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51af19-fa90-44de-aeaa-c2c0bfb51dd1 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.538211 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1449/2889] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:04:43.542249 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:43.552647 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8b661-bad1-492a-8d7f-c3e0b5af1cba admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:43.557216 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:43.557906 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:43.558170 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:43.558444 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] PATH_INFO: `/v3/projects/05443568109c4fdebb8b1a221f8363c3/users/d7f80cc027654e97bafa216b2bcd70c8/roles/a56cff897dbf420ba7ea1c0895e3c4f0` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:43.560350 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05443568109c4fdebb8b1a221f8363c3, user_id=d7f80cc027654e97bafa216b2bcd70c8, role_id=a56cff897dbf420ba7ea1c0895e3c4f0)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:43.563159 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ce78-4f13-4a09-b3f3-846cd9ab95cc admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:43.573667 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1441/2890] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:04:43 2022] PUT /identity/v3/projects/05443568109c4fdebb8b1a221f8363c3/users/d7f80cc027654e97bafa216b2bcd70c8/roles/a56cff897dbf420ba7ea1c0895e3c4f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:04:44.456181 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:44.456708 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:44.456823 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:44.488082 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] MFA Rules not processed for user `d7f80cc027654e97bafa216b2bcd70c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:44.489335 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:44.571436 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1450/2891] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:44.583986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:44.584511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:44.584511 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:44.605215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] MFA Rules not processed for user `66b1b6c5e337437c98e39bca152be598`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:04:44.606501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:44.677594 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1442/2892] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:04:44.689717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:44.691272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:44.786120 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5079da-a6cd-45a8-8b46-6a834e3d6589 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:44.791735 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:44.792357 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:44.792639 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:44.792911 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:44.801403 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:44.803002 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:44.812804 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1451/2893] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:45.838156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:45.839632 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:45.912820 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfc8b6-d424-4680-b29c-b8933e464529 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:45.917892 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:45.918558 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:45.918782 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:45.919061 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:45.921012 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:45.932734 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:45.934333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:45.944955 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1443/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:51.825584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:51.874291 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=100 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:04:51.880187 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755518-bce2-429d-87b9-6a94a5ba51c5 service nova] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:51.883876 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:51.884494 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:51.884782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:51.885070 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:51.886887 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:51.948107 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:51.949798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:51.960659 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1452/2895] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:04:55.436098 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:04:55.457285 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258466-d9e5-45ff-9337-c489912ada47 service placement] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:04:55.470490 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:04:55.471243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:04:55.471763 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:04:55.472290 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:04:55.475295 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:04:55.494530 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:04:55.496895 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:04:55.512485 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1444/2896] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:05:00.070350 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:00.071730 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:00.128131 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230cf-e6be-4fc4-afa8-6eb49218ec50 service neutron] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:00.131602 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:00.132214 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:00.132496 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:00.132771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:00.142591 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:00.144011 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:00.153281 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1453/2897] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:05:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:05:05.506931 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:10.149156 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=55 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:19.668791 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:19.731605 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18fb2-060d-47a2-97df-1b910709c04e service nova] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:19.736030 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:19.736664 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:19.736948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:19.737225 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] PATH_INFO: `/v3/users/66b1b6c5e337437c98e39bca152be598` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:19.739193 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b1b6c5e337437c98e39bca152be598)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:19.741359 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:19.786817 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b1b6c5e337437c98e39bca152be598'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:19.794040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b1b6c5e337437c98e39bca152be598'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:19.794678 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b1b6c5e337437c98e39bca152be598'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:19.803447 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b1b6c5e337437c98e39bca152be598'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:19.816412 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b1b6c5e337437c98e39bca152be598'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:19.822405 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1445/2898] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:05:19 2022] DELETE /identity/v3/users/66b1b6c5e337437c98e39bca152be598 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:20.027842 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:20.040096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d014-3f0c-48d4-9aed-a6319f36b775 service cinder] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:20.107596 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:20.108251 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.108534 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.108813 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] PATH_INFO: `/v3/projects/b969065d7434469a941152fde54433e5` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.110014 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b969065d7434469a941152fde54433e5)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:20.111946 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:20.171900 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b969065d7434469a941152fde54433e5', 'request_id': 'req-3415e23e-3748-42d9-ade5-cd15d71b3cb6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.182736 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b969065d7434469a941152fde54433e5', 'request_id': 'req-3415e23e-3748-42d9-ade5-cd15d71b3cb6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.190283 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b969065d7434469a941152fde54433e5', 'request_id': 'req-3415e23e-3748-42d9-ade5-cd15d71b3cb6'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.208042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] The token cache is being invalidate because project b969065d7434469a941152fde54433e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:05:20.208336 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.209034 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.210590 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1454/2899] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:05:20 2022] DELETE /identity/v3/projects/b969065d7434469a941152fde54433e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:20.214635 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:20.216237 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:20.233316 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7575-e668-4f4e-af2d-03b50f2313de admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:20.314908 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:20.315471 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.315785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.316066 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] PATH_INFO: `/v3/users/d7f80cc027654e97bafa216b2bcd70c8` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.317305 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f80cc027654e97bafa216b2bcd70c8)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:20.319460 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:20.343492 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:20.379276 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f80cc027654e97bafa216b2bcd70c8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.387421 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f80cc027654e97bafa216b2bcd70c8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.388091 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f80cc027654e97bafa216b2bcd70c8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.397974 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f80cc027654e97bafa216b2bcd70c8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.413063 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-74056dfd-489e-49f1-b659-3fa344e8e698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f80cc027654e97bafa216b2bcd70c8'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.419258 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1446/2900] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:05:20 2022] DELETE /identity/v3/users/d7f80cc027654e97bafa216b2bcd70c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:20.623411 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:20.624843 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:20.639144 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e23e-3748-42d9-ade5-cd15d71b3cb6 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:20.704366 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:20.705051 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.705345 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.705625 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] PATH_INFO: `/v3/projects/05443568109c4fdebb8b1a221f8363c3` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.707655 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05443568109c4fdebb8b1a221f8363c3)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:20.710290 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:20.746536 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:20.760676 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05443568109c4fdebb8b1a221f8363c3', 'request_id': 'req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.766816 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05443568109c4fdebb8b1a221f8363c3', 'request_id': 'req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.775053 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05443568109c4fdebb8b1a221f8363c3', 'request_id': 'req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.785268 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] The token cache is being invalidate because project 05443568109c4fdebb8b1a221f8363c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:05:20.785532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.786178 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-29b8094b-1e40-4ca5-8bf2-8f73107dfb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:20.787674 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1455/2901] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:05:20 2022] DELETE /identity/v3/projects/05443568109c4fdebb8b1a221f8363c3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 13:05:20.792494 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.792988 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.793088 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.812246 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:05:20.813435 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:20.873104 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1447/2902] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:05:20.881124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.881415 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.881698 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.904302 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:05:20.905523 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:20.914231 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1456/2903] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:05:20.918560 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:20.928484 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d81f81-55c1-4d7a-a6f4-4115fe693cb1 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:20.933036 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:20.933637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.933948 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.934230 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] PATH_INFO: `/v3/domains` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.934924 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 13:05:20.935257 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:20.936846 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:20.948954 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1448/2904] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Jul 26 13:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 13:05:20.953935 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:20.964158 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb85db-fa14-4698-aa6b-09ade9681358 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:20.968874 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:20.969483 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:20.969771 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:20.970085 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:20.970760 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:20.972695 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.000226 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1457/2905] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Jul 26 13:05:20 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 13:05:21.005241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.018113 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956ae4-4710-40e4-b6cc-99aba732b853 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.076145 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.076759 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.077046 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.077322 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.078026 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.079930 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.100699 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1449/2906] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Jul 26 13:05:21 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 13:05:21.104878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.116878 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ebdce-d03e-4ec1-bc16-1d8871a89f67 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.121532 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.122217 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.122507 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.122791 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] PATH_INFO: `/v3/roles` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.123548 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.125089 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.135658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1458/2907] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:05:21.139509 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.149372 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7598-a422-40c4-bf04-fd9d3b3550d5 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.153987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.154589 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.154873 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.155151 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.155845 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.157427 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309dee2-1960-4232-adf2-0babbbae03ca admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.167916 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1450/2908] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Jul 26 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 13:05:21.171858 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.182433 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e1de-b86e-4a55-a1fb-773aefdd051a admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.187025 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.187672 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] REQUEST_METHOD: `PUT` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.187953 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.188229 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] PATH_INFO: `/v3/projects/45eb709e1f294a84b1d832a653216377/users/e6c572415c174e1c8bbdc53cad2fc0bc/roles/c8019a06791c4c888509f83d28e2ce55` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.204058 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45eb709e1f294a84b1d832a653216377, user_id=e6c572415c174e1c8bbdc53cad2fc0bc, role_id=c8019a06791c4c888509f83d28e2ce55)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.206888 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.220038 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1459/2909] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Jul 26 13:05:21 2022] PUT /identity/v3/projects/45eb709e1f294a84b1d832a653216377/users/e6c572415c174e1c8bbdc53cad2fc0bc/roles/c8019a06791c4c888509f83d28e2ce55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:21.230921 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] REQUEST_METHOD: `POST` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.231215 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.231500 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.240705 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:21.261637 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.auth.core [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] MFA Rules not processed for user `e6c572415c174e1c8bbdc53cad2fc0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:05:21.262874 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:21.327045 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1451/2910] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:05:21.337782 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.339513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:21.395785 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe12f6-4c5a-477f-b1dc-0f81bf09d488 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.399297 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.399903 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.400184 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.400459 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.408598 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.410574 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476a6c-0d27-4460-a598-7cf71da0937c service cinder] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.419206 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1460/2911] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:05:21.439369 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.500614 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fc645-51b0-4984-b51b-251c17a62d48 None None] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.505149 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.505774 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.506097 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.506371 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] PATH_INFO: `/v3/users/e6c572415c174e1c8bbdc53cad2fc0bc` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.507640 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c572415c174e1c8bbdc53cad2fc0bc)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.509526 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.555342 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c572415c174e1c8bbdc53cad2fc0bc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:21.562733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c572415c174e1c8bbdc53cad2fc0bc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:21.563364 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c572415c174e1c8bbdc53cad2fc0bc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:21.570532 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c572415c174e1c8bbdc53cad2fc0bc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:21.582273 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c572415c174e1c8bbdc53cad2fc0bc'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:21.587977 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1452/2912] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:05:21 2022] DELETE /identity/v3/users/e6c572415c174e1c8bbdc53cad2fc0bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:21.592503 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51baee-f838-4001-ab63-db0b44332968 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.592797 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51baee-f838-4001-ab63-db0b44332968 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.593083 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51baee-f838-4001-ab63-db0b44332968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.612400 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-df51baee-f838-4001-ab63-db0b44332968 None None] MFA Rules not processed for user `e89b70cb0e524eabb8d969a04efaa804`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:05:21.614384 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-df51baee-f838-4001-ab63-db0b44332968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:21.666544 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:21.677526 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1461/2913] 10.222.0.47 () {58 vars in 958 bytes} [Tue Jul 26 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 13:05:21.687087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:21.688462 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:21.702733 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:21.748133 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db892-89ba-432f-9160-06c6276668d8 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:21.751727 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:21.752341 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:21.752622 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:21.752900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:21.761971 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:21.763388 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:21.773222 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1453/2914] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:05:22.043137 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51baee-f838-4001-ab63-db0b44332968 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:05:22.046118 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-df51baee-f838-4001-ab63-db0b44332968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:05:22.059599 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51baee-f838-4001-ab63-db0b44332968 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:05:22.064310 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:05:22.064988 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:05:22.065272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:05:22.065866 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] PATH_INFO: `/v3/projects/45eb709e1f294a84b1d832a653216377` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:05:22.066980 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45eb709e1f294a84b1d832a653216377)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:05:22.069005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:05:22.117368 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45eb709e1f294a84b1d832a653216377', 'request_id': 'req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:22.123853 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45eb709e1f294a84b1d832a653216377', 'request_id': 'req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:22.132124 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45eb709e1f294a84b1d832a653216377', 'request_id': 'req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:22.143005 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] The token cache is being invalidate because project 45eb709e1f294a84b1d832a653216377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:05:22.143392 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:22.144589 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:05:22.146172 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1462/2915] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:05:22 2022] DELETE /identity/v3/projects/45eb709e1f294a84b1d832a653216377 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:05:31.768568 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=20 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:05:32.139962 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:07:11.618235 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:11.619712 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:11.631109 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ce17-de97-43d5-aaa7-d1000cea9db3 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:11.682262 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12b699d6f6c4047a4b414e0ccff2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:11.683016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:11.683477 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:11.683761 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:11.685541 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:11.756852 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:11.758308 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:11.769877 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1454/2916] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:07:12.221658 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:12.224416 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:12.269513 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5d63e-45bc-4269-aa3d-3dc2f79416d4 admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:12.280128 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af669281-2c87-4927-9186-48253a761022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dd08e0da964403bf7d7e2b34669efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:12.280917 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669281-2c87-4927-9186-48253a761022 service nova] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:12.281272 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669281-2c87-4927-9186-48253a761022 service nova] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:12.281624 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669281-2c87-4927-9186-48253a761022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:12.284213 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-af669281-2c87-4927-9186-48253a761022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:12.300815 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af669281-2c87-4927-9186-48253a761022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:12.302472 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af669281-2c87-4927-9186-48253a761022 service nova] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:12.318010 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1463/2917] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:07:14.653150 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:14.654717 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:14.717265 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06daf-7874-4581-a0a9-8b6c6bd5cc41 service neutron] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:14.720890 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2135e982052e41cc834c5c0a6608decc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:14.721502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:14.721785 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:14.722092 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:14.723862 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:14.737333 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:14.738778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:14.750255 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1455/2918] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:07:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:07:19.898987 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] REQUEST_METHOD: `POST` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:19.899420 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:19.899584 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:19.919316 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.auth.core [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] MFA Rules not processed for user `71beef48ee884f8fafc75df6766d1064`. Rule list: `[]` (Enabled: `True`). {{(pid=91770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 13:07:19.920525 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:19.975261 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1464/2919] 10.222.0.47 () {58 vars in 967 bytes} [Tue Jul 26 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 13:07:20.020339 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:20.021729 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:20.070080 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=100 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:07:20.092928 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c25488-e79e-410f-a8f3-52fb0f61aba4 service cinder] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:20.097891 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182ee307b1394f72bc71477eb027da49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:20.098502 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:20.098781 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:20.099056 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:20.108050 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:20.109986 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:20.118184 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1456/2920] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Jul 26 13:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 13:07:23.389999 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:23.391423 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:23.468152 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d84fd-675e-425f-9cce-f76beed34702 None None] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:23.473338 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:23.474007 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] REQUEST_METHOD: `GET` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:23.474301 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:23.474583 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:23.476362 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:23.488855 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:23.490463 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:23.501542 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1465/2921] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:07:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:07:26.580087 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:26.581516 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:26.648987 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2e4d-0fbf-4795-9bff-72fa83b24a75 service swift] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:26.653495 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:26.654156 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:26.654431 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:26.654744 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] PATH_INFO: `/v3/users/f1409edcf43240ee83460037d78ece2b` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:26.655886 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1409edcf43240ee83460037d78ece2b)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:26.657911 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:26.703549 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1409edcf43240ee83460037d78ece2b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:26.710937 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1409edcf43240ee83460037d78ece2b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:26.711691 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1409edcf43240ee83460037d78ece2b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:26.719110 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1409edcf43240ee83460037d78ece2b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:26.731958 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1409edcf43240ee83460037d78ece2b'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:26.737778 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1457/2922] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:07:26 2022] DELETE /identity/v3/users/f1409edcf43240ee83460037d78ece2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:07:26.915236 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:26.927696 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceb64c-44af-4803-b7a2-66736913731f service placement] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:26.985718 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:26.986385 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:26.986667 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:26.986943 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] PATH_INFO: `/v3/projects/fa00345ed1874deda6c56753cc29f8d9` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:26.988086 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa00345ed1874deda6c56753cc29f8d9)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:26.990028 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:27.013772 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:07:27.038123 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa00345ed1874deda6c56753cc29f8d9', 'request_id': 'req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.045042 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa00345ed1874deda6c56753cc29f8d9', 'request_id': 'req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.052473 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa00345ed1874deda6c56753cc29f8d9', 'request_id': 'req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.062802 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] The token cache is being invalidate because project fa00345ed1874deda6c56753cc29f8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:07:27.063096 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.063717 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.065241 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1466/2923] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:07:26 2022] DELETE /identity/v3/projects/fa00345ed1874deda6c56753cc29f8d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:07:27.069221 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:27.070633 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:27.083900 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635fd4a-2172-41f5-a1d8-5066df84d464 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:27.132899 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:07:27.143016 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:27.143683 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:27.143966 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:27.144243 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] PATH_INFO: `/v3/users/2471729723fe4539b5f2bd3025198504` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:27.145406 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2471729723fe4539b5f2bd3025198504)` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:27.147355 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:27.193554 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2471729723fe4539b5f2bd3025198504'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.201580 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2471729723fe4539b5f2bd3025198504'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.202264 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2471729723fe4539b5f2bd3025198504'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.209669 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2471729723fe4539b5f2bd3025198504'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.222591 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.notifications [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2471729723fe4539b5f2bd3025198504'} {{(pid=91771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.228470 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1458/2924] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Jul 26 13:07:27 2022] DELETE /identity/v3/users/2471729723fe4539b5f2bd3025198504 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:07:27.406600 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Authenticating user token {{(pid=91770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:07:27.408265 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.fernet_utils [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:07:27.422448 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b3456-28f8-49a2-b2e6-7b9b5141db8b admin admin] Validating token access rules against request {{(pid=91770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:07:27.484309 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89b70cb0e524eabb8d969a04efaa804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269bfb061a4341bbbc905a39cb4bf398', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:07:27.484979 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:07:27.485260 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:07:27.485535 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] PATH_INFO: `/v3/projects/d921c8d80fa946ea9080413332b5afaa` {{(pid=91770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:07:27.486795 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d921c8d80fa946ea9080413332b5afaa)` {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:07:27.488741 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] RBAC: Authorization granted {{(pid=91770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:07:27.539981 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd921c8d80fa946ea9080413332b5afaa', 'request_id': 'req-7d9e3d95-a8b0-433b-8689-a297d13542f4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.546630 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd921c8d80fa946ea9080413332b5afaa', 'request_id': 'req-7d9e3d95-a8b0-433b-8689-a297d13542f4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.558890 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd921c8d80fa946ea9080413332b5afaa', 'request_id': 'req-7d9e3d95-a8b0-433b-8689-a297d13542f4'} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.570835 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] The token cache is being invalidate because project d921c8d80fa946ea9080413332b5afaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 13:07:27.571135 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.571798 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG keystone.notifications [None req-7d9e3d95-a8b0-433b-8689-a297d13542f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 13:07:27.574215 dv-cinder-850939-2-smb devstack@keystone.service[91770]: [pid: 91770|app: 0|req: 1467/2925] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Jul 26 13:07:27 2022] DELETE /identity/v3/projects/d921c8d80fa946ea9080413332b5afaa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 13:07:37.225040 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:07:37.567562 dv-cinder-850939-2-smb devstack@keystone.service[91770]: DEBUG dbcounter [-] [91770] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:09:46.104922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Authenticating user token {{(pid=91771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 13:09:46.106363 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:09:46.243611 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4cdd-1f9f-41a9-bbbb-ec680dc7b525 admin admin] Validating token access rules against request {{(pid=91771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 13:09:46.302393 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbdfe23df8c4200ac0d437c075942d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046389bcbc1749f68c60601c6f651601', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 13:09:46.302938 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] REQUEST_METHOD: `GET` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 13:09:46.303227 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] SCRIPT_NAME: `/identity` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 13:09:46.303501 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 13:09:46.305241 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.fernet_utils [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 13:09:46.316922 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 13:09:46.318539 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b0199-48a5-4112-8b10-cb2f005a24de service placement] RBAC: Authorization granted {{(pid=91771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 13:09:46.329162 dv-cinder-850939-2-smb devstack@keystone.service[91771]: [pid: 91771|app: 0|req: 1459/2926] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Jul 26 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 13:09:56.324115 dv-cinder-850939-2-smb devstack@keystone.service[91771]: DEBUG dbcounter [-] [91771] Writing DB stats keystone:SELECT=89 {{(pid=91771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}